Jul 08 00:51:15 devstack cinder-volume[75600]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 00:51:15 devstack cinder-volume[75600]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 00:51:15 devstack cinder-volume[75600]: we strongly recommend against using it for new projects. Jul 08 00:51:15 devstack cinder-volume[75600]: If you are already using Eventlet, we recommend migrating to a different Jul 08 00:51:15 devstack cinder-volume[75600]: framework. For more detail see Jul 08 00:51:15 devstack cinder-volume[75600]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 00:51:15 devstack cinder-volume[75600]: import eventlet # noqa Jul 08 00:51:18 devstack cinder-volume[75600]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75600) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 00:51:18 devstack cinder-volume[75600]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75600) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 00:51:18 devstack cinder-volume[75600]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75600) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 00:51:18 devstack cinder-volume[75600]: INFO dbcounter [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Registered counter for database cinder Jul 08 00:51:19 devstack cinder-volume[75600]: DEBUG oslo_db.sqlalchemy.engines [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75600) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 00:51:19 devstack cinder-volume[75600]: DEBUG dbcounter [-] [75600] Writer thread running {{(pid=75600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 00:51:19 devstack cinder-volume[75600]: INFO cinder.rpc [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 00:51:19 devstack cinder-volume[75600]: INFO cinder.rpc [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 00:51:19 devstack cinder-volume[75600]: DEBUG oslo_db.sqlalchemy.engines [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75600) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 00:51:19 devstack cinder-volume[75600]: INFO cinder.volume.manager [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Determined volume DB was empty at startup. Jul 08 00:51:19 devstack cinder-volume[75600]: DEBUG cinder.volume.manager [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75600) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 00:51:19 devstack cinder-volume[75600]: INFO cinder.volume.manager [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 00:51:19 devstack cinder-volume[75600]: WARNING stevedore.named [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 00:51:19 devstack cinder-volume[75600]: WARNING castellan.key_manager [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 00:51:19 devstack cinder-volume[75600]: WARNING cinder.keymgr.conf_key_mgr [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 00:51:19 devstack cinder-volume[75600]: DEBUG cinder.volume.drivers.lvm [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75600) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 08 00:51:19 devstack cinder-volume[75600]: DEBUG oslo_concurrency.processutils [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_concurrency.processutils [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] CMD "cinder-rtstool verify" returned: 0 in 0.532s {{(pid=75600) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_db.sqlalchemy.engines [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75600) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 00:51:20 devstack cinder-volume[75600]: INFO cinder.rpc [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 08 00:51:20 devstack cinder-volume[75600]: INFO cinder.rpc [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 08 00:51:20 devstack cinder-volume[75600]: WARNING stevedore.named [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 00:51:20 devstack cinder-volume[75600]: WARNING castellan.key_manager [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 00:51:20 devstack cinder-volume[75600]: INFO cinder.volume.manager [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_db.sqlalchemy.engines [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75600) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 00:51:20 devstack cinder-volume[75600]: INFO oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Starting 1 workers Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Started child 75772 {{(pid=75600) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Full set of CONF: {{(pid=75600) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] ******************************************************************************** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Configuration options gathered from: {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] ================================================================================ {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] allow_availability_zone_fallback = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] allow_compression_on_image_upload = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] allowed_direct_url_schemes = [] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] api_rate_limit = True {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] auth_strategy = keystone {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75772]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] az_cache_duration = 3600 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_availability_zone = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_host = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_name = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_stats_polling_interval = 60 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backup_api_class = cinder.backup.api.API {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backup_name_template = backup-%s {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backup_use_same_host = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backup_use_temp_snapshot = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] chap_password = **** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] chap_username = {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cinder_internal_tenant_project_id = f20b495ecb70429b8dd66a84f83079de {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cinder_internal_tenant_user_id = 43adf74fc8934a7ba265d8bda3c8ecbc {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cloned_volume_same_az = True {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cluster = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] compression_format = gzip {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] compute_api_class = cinder.compute.nova.API {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] config_dir = [] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] config_source = [] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] control_exchange = openstack {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] debug = True {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] default_availability_zone = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] default_group_type = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] default_volume_type = lvmdriver-1 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] disk_geometry = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] driver_client_cert = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] driver_client_cert_key = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] driver_data_namespace = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] driver_ssl_cert_path = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] driver_ssl_cert_verify = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] driver_use_ssl = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] enable_force_upload = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] enable_new_services = True {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] enable_unsupported_driver = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] enforce_multipath_for_image_xfer = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] filter_function = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] glance_api_insecure = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] glance_api_servers = ['http://192.168.122.200/image'] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] glance_api_ssl_compression = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] glance_ca_certificates_file = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] glance_catalog_info = image:glance:publicURL {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] glance_certfile = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] glance_keyfile = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] glance_num_retries = 3 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] glance_request_timeout = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] goodness_function = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] graceful_shutdown_timeout = 5 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] group_api_class = cinder.group.api.API {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] host = devstack {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] image_compress_on_upload = True {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] image_conversion_address_space_limit = 1 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] image_conversion_cpu_limit = 60 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] image_conversion_disable = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] image_upload_use_cinder_backend = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] image_upload_use_internal_tenant = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack sudo[75777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] image_volume_cache_enabled = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] image_volume_cache_max_count = 0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] image_volume_cache_max_size_gb = 0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] init_host_max_objects_retrieval = 0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] instance_format = [instance: %(uuid)s] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] iscsi_target_flags = {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] iscsi_write_cache = on {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] iser_helper = tgtadm {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] iser_ip_address = 192.168.122.200 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] iser_port = 3260 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] log_color = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] log_config_append = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] log_dir = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] log_file = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] log_options = True {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] log_rotate_interval = 1 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] log_rotate_interval_type = days {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] log_rotation_type = none {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack sudo[75777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] max_age = 0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] max_logfile_count = 30 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] max_logfile_size_mb = 200 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] max_over_subscription_ratio = 20.0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] message_reap_interval = 86400 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] message_ttl = 2592000 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] migration_create_volume_timeout_secs = 300 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] monkey_patch = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] monkey_patch_modules = [] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] my_ip = 192.168.122.200 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] no_snapshot_gb_quota = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] num_iser_scan_tries = 3 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] num_shell_tries = 3 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] num_volume_device_scan_tries = 3 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] nvmeof_conn_info_version = 1 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] nvmet_ns_id = 10 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] nvmet_port_id = 1 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] osapi_max_limit = 1000 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] osapi_volume_ext_list = [] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] osapi_volume_listen_port = 8776 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] osapi_volume_use_ssl = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] osapi_volume_workers = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] per_volume_size_limit = -1 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75772]: INFO cinder.volume.manager [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] periodic_fuzzy_delay = 60 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] periodic_interval = 60 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] public_endpoint = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] publish_errors = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] quota_backup_gigabytes = 1000 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] quota_backups = 10 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] quota_gigabytes = 1000 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] quota_groups = 10 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] quota_snapshots = 10 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] quota_volumes = 10 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] rate_limit_burst = 0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] rate_limit_except_level = CRITICAL {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] rate_limit_interval = 0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] reinit_driver_count = 3 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] replication_device = **** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] report_discard_supported = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] report_interval = 120 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] reservation_clean_interval = 86400 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] reservation_expire = 86400 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] reserved_image_namespaces = [] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] reserved_percentage = 0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] rpc_response_timeout = 120 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] run_external_periodic_tasks = True {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] scst_target_driver = iscsi {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] scst_target_iqn_name = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] service_down_time = 720 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] shell_completion = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] snapshot_name_template = snapshot-%s {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] snapshot_same_host = True {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] split_loggers = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] state_path = /opt/stack/data/cinder {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] storage_availability_zone = nova {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] storage_protocol = iSCSI {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] syslog_log_facility = LOG_USER {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] target_helper = lioadm {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] target_ip_address = 192.168.122.200 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] target_port = 3260 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] target_protocol = iscsi {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] target_secondary_ip_addresses = [] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] trace_flags = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] transport_url = **** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] until_refresh = 0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] use_chap_auth = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] use_default_quota_class = True {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] use_journal = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] use_json = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] use_multipath_for_image_xfer = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] use_stderr = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] use_syslog = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] verify_glance_signatures = enabled {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] volume_api_class = cinder.volume.api.API {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] volume_backend_name = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] volume_clear = zero {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] volume_clear_ionice = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] volume_clear_size = 0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] volume_copy_bps_limit = 0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] volume_dd_blocksize = 1M {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] volume_name_template = volume-%s {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] volume_service_inithost_offload = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] volume_usage_audit_period = month {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] zoning_mode = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_concurrency.disable_process_locking = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.auth_section = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.auth_type = password {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.auth_version = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.cache = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.certfile = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.include_service_catalog = True {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.insecure = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.interface = public {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.keyfile = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.memcache_password = {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.memcache_username = {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.region_name = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.service_type = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.200/identity {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.backend = dogpile.cache.null {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.backend_argument = **** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.backend_expiration_time = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.config_prefix = cache.oslo {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.debug_cache_backend = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.enable_retry_client = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.enable_socket_keepalive = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.enabled = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.expiration_time = 600 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.hashclient_retry_attempts = 2 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.memcache_dead_retry = 300 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.memcache_pool_maxsize = 10 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.memcache_sasl_enabled = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.password = **** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.proxies = [] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.redis_db = 0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.redis_server = localhost:6379 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.retry_attempts = 2 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.retry_delay = 0.0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.socket_keepalive_count = 1 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.socket_keepalive_idle = 1 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.socket_keepalive_interval = 1 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.socket_timeout = 1.0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.tls_allowed_ciphers = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.tls_cafile = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.tls_certfile = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.tls_enabled = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.tls_keyfile = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cache.username = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] coordination.backend_url = **** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.asyncio_connection = **** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.asyncio_slave_connection = **** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.backend = sqlalchemy {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.connection = **** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.connection_debug = 0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.connection_parameters = {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.connection_recycle_time = 3600 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.connection_trace = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.db_inc_retry_interval = True {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.db_max_retries = 20 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.db_max_retry_interval = 10 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.db_retry_interval = 1 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.max_overflow = 50 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.max_pool_size = 5 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.max_retries = 10 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.mysql_wsrep_sync_wait = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.pool_timeout = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.retry_interval = 10 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.slave_connection = **** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.sqlite_synchronous = True {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.synchronous_reader = True {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] database.use_db_reconnect = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] profiler.connection_string = messaging:// {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] profiler.enabled = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] profiler.es_doc_type = notification {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] profiler.es_scroll_size = 10000 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] profiler.es_scroll_time = 2m {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] profiler.filter_error_trace = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] profiler.hmac_keys = **** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] profiler.sentinel_service_name = mymaster {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] profiler.socket_timeout = 0.1 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] profiler.trace_requests = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] profiler.trace_sqlalchemy = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] profiler_jaeger.process_tags = {} {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] profiler_jaeger.service_name_prefix = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] profiler_otlp.service_name_prefix = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_policy.enforce_new_defaults = True {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_policy.enforce_scope = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_policy.policy_default_rule = default {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_policy.policy_file = policy.yaml {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] privsep_osbrick.group = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] privsep_osbrick.helper_command = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] privsep_osbrick.user = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cinder_sys_admin.group = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cinder_sys_admin.helper_command = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] cinder_sys_admin.user = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] service_user.auth_section = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] service_user.auth_type = password {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] service_user.cafile = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] service_user.certfile = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] service_user.collect_timing = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] service_user.insecure = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] service_user.keyfile = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] service_user.send_service_user_token = True {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] service_user.split_loggers = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] service_user.timeout = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] glance.auth_section = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] glance.auth_type = password {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] glance.certfile = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] glance.collect_timing = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] glance.insecure = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] glance.keyfile = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] glance.region_name = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] glance.split_loggers = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] glance.timeout = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.backend_availability_zone = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.chap_password = **** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.chap_username = {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.disk_geometry = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.driver_client_cert = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.driver_client_cert_key = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.driver_data_namespace = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.driver_use_ssl = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.extra_capabilities = {} {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.filter_function = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.goodness_function = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.iscsi_target_flags = {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.iscsi_write_cache = on {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.iser_helper = tgtadm {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.iser_ip_address = 192.168.122.200 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.iser_port = 3260 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.lvm_share_target = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.lvm_type = auto {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.num_shell_tries = 3 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.replication_device = **** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.report_discard_supported = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.reserved_percentage = 0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.target_helper = tgtadm {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.target_ip_address = 192.168.122.200 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.target_port = 3260 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.target_protocol = iscsi {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.trace_flags = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.unique_fqdn_network = True {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.use_chap_auth = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.volume_backend_name = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.volume_clear = zero {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.volume_clear_ionice = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.volume_clear_size = 0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_reports.file_event_handler = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_reports.log_dir = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.backend_host = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.chap_password = **** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.chap_username = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.disk_geometry = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.driver_client_cert = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.extra_capabilities = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.filter_function = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.goodness_function = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.iser_helper = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.iser_ip_address = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.iser_port = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.lvm_share_target = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.lvm_type = auto {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.num_shell_tries = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.replication_device = **** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.report_discard_supported = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.reserved_percentage = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.scst_target_driver = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.storage_protocol = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.target_helper = lioadm {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.target_ip_address = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.target_port = 3260 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.trace_flags = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.use_chap_auth = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.volume_clear = zero {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.volume_clear_size = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] lvmdriver-1.volumes_dir = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.ssl = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_notifications.driver = [] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_notifications.retry = -1 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] key_manager.fixed_key = **** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican.barbican_api_version = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican.barbican_endpoint = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican.barbican_endpoint_type = public {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican.barbican_region_name = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican.cafile = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican.certfile = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican.collect_timing = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican.insecure = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican.keyfile = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican.number_of_retries = 60 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican.retry_delay = 1 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican.send_service_user_token = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican.split_loggers = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican.timeout = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican.verify_ssl = True {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican.verify_ssl_path = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican_service_user.auth_section = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican_service_user.auth_type = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican_service_user.cafile = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican_service_user.certfile = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican_service_user.collect_timing = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican_service_user.insecure = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican_service_user.keyfile = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican_service_user.split_loggers = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] barbican_service_user.timeout = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] vault.approle_role_id = **** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] vault.approle_secret_id = **** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] vault.kv_mountpoint = secret {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] vault.kv_path = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] vault.kv_version = 2 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] vault.namespace = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] vault.root_token_id = **** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] vault.ssl_ca_crt_file = None {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] vault.timeout = 60.0 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] vault.use_ssl = False {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:51:20 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] ******************************************************************************** {{(pid=75600) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 00:51:21 devstack sudo[75777]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:21 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.829s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:21 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:21 devstack sudo[75850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:51:21 devstack sudo[75850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:22 devstack sudo[75850]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:22 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.835s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:22 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 00:51:22 devstack cinder-volume[75772]: INFO cinder.brick.local_dev.lvm [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 08 00:51:22 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:22 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:22 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:22 devstack sudo[76169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 00:51:22 devstack sudo[76169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:23 devstack sudo[76169]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:23 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.864s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:23 devstack cinder-volume[75772]: DEBUG cinder.brick.local_dev.lvm [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75772) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 08 00:51:23 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:23 devstack sudo[76344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:51:23 devstack sudo[76344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:24 devstack sudo[76344]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:24 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.314s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:24 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:24 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:24 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:24 devstack sudo[76550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:51:24 devstack sudo[76550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:25 devstack sudo[76550]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:25 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.866s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:25 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:25 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:25 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:25 devstack sudo[76556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 08 00:51:25 devstack sudo[76556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:26 devstack sudo[76556]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:26 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.902s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:26 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:26 devstack sudo[76560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 00:51:26 devstack sudo[76560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:27 devstack sudo[76560]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:27 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.132s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:27 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:27 devstack sudo[76566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 00:51:27 devstack sudo[76566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:28 devstack sudo[76566]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:28 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.063s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:28 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:28 devstack sudo[76579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:51:28 devstack sudo[76579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:29 devstack sudo[76579]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:29 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.788s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:29 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:29 devstack sudo[76587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:51:29 devstack sudo[76587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:30 devstack sudo[76587]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:30 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.892s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:30 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:30 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:30 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:30 devstack sudo[76598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:51:30 devstack sudo[76598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:30 devstack cinder-volume[75600]: DEBUG dbcounter [-] [75600] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75600) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 00:51:30 devstack sudo[76598]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:30 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.784s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:30 devstack cinder-volume[75772]: INFO cinder.volume.drivers.lvm [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 08 00:51:30 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:30 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:30 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:30 devstack sudo[76712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:51:30 devstack sudo[76712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:31 devstack sudo[76712]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:31 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.700s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:31 devstack cinder-volume[75772]: DEBUG cinder.volume.drivers.lvm [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Updating volume stats {{(pid=75772) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 00:51:31 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:31 devstack sudo[76855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 00:51:31 devstack sudo[76855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:32 devstack sudo[76855]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:32 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.682s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:32 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:32 devstack sudo[76858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:51:32 devstack sudo[76858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:33 devstack sudo[76858]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:33 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.756s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:33 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:33 devstack sudo[76861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:51:33 devstack sudo[76861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:33 devstack sudo[76861]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:33 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.751s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:33 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:33 devstack sudo[76864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:51:33 devstack sudo[76864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:34 devstack sudo[76864]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:34 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.691s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:34 devstack cinder-volume[75772]: INFO cinder.volume.driver [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Driver hasn't implemented _init_vendor_properties() Jul 08 00:51:34 devstack cinder-volume[75772]: DEBUG cinder.volume.driver [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75772) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 00:51:34 devstack cinder-volume[75772]: DEBUG oslo_db.sqlalchemy.engines [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75772) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 00:51:34 devstack cinder-volume[75772]: DEBUG dbcounter [-] [75772] Writer thread running {{(pid=75772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 00:51:34 devstack cinder-volume[75772]: DEBUG cinder.db.api [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Building query based on filter {{(pid=75772) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 00:51:34 devstack cinder-volume[75772]: DEBUG cinder.image.image_utils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75772) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 00:51:34 devstack cinder-volume[75772]: INFO cinder.keymgr.migration [None req-1a2deeef-7046-4f13-ac4b-f02cc24b3ddb None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 00:51:34 devstack cinder-volume[75772]: DEBUG cinder.volume.drivers.lvm [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Updating volume stats {{(pid=75772) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 00:51:34 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:34 devstack sudo[76869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 00:51:34 devstack sudo[76869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:35 devstack sudo[76869]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:35 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.798s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:35 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:35 devstack sudo[76872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:51:35 devstack sudo[76872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:36 devstack sudo[76872]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:36 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.696s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:36 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:36 devstack sudo[76879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:51:36 devstack sudo[76879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:36 devstack sudo[76879]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:36 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.762s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:36 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:36 devstack sudo[76882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:51:36 devstack sudo[76882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:37 devstack sudo[76882]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:37 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.821s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:37 devstack cinder-volume[75772]: DEBUG cinder.manager [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Notifying Schedulers of capabilities ... {{(pid=75772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 00:51:37 devstack cinder-volume[75772]: INFO cinder.volume.manager [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Driver initialization completed successfully. Jul 08 00:51:37 devstack cinder-volume[75772]: INFO cinder.manager [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Initiating service 2 cleanup Jul 08 00:51:37 devstack cinder-volume[75772]: INFO cinder.manager [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Service 2 cleanup completed. Jul 08 00:51:37 devstack cinder-volume[75772]: DEBUG cinder.service [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Creating RPC server for service cinder-volume {{(pid=75772) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 00:51:37 devstack cinder-volume[75772]: DEBUG cinder.service [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75772) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 00:51:38 devstack cinder-volume[75772]: INFO cinder.volume.manager [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 08 00:51:38 devstack cinder-volume[75772]: DEBUG cinder.volume.drivers.lvm [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Updating volume stats {{(pid=75772) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 00:51:38 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:38 devstack sudo[76886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 00:51:38 devstack sudo[76886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:38 devstack sudo[76886]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:38 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.723s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:38 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:38 devstack sudo[76889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:51:38 devstack sudo[76889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:39 devstack sudo[76889]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:39 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.703s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:39 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:39 devstack sudo[76950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:51:39 devstack sudo[76950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:40 devstack sudo[76950]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:40 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.679s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:40 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:51:40 devstack sudo[76954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:51:40 devstack sudo[76954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:51:40 devstack sudo[76954]: pam_unix(sudo:session): session closed for user root Jul 08 00:51:40 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.737s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:51:40 devstack cinder-volume[75772]: INFO cinder.volume.manager [None req-ca1857c9-2c90-44e3-b7cd-9fdf43b16dcf None None] Driver post RPC initialization completed successfully. Jul 08 00:51:50 devstack cinder-volume[75772]: DEBUG dbcounter [-] [75772] Writing DB stats cinder:SELECT=12,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 00:51:50 devstack cinder-volume[75772]: DEBUG dbcounter [-] [75772] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=75772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 00:52:36 devstack cinder-volume[75772]: DEBUG oslo_service.periodic_task [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 00:52:36 devstack cinder-volume[75772]: DEBUG cinder.volume.drivers.lvm [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Updating volume stats {{(pid=75772) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 00:52:36 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:52:36 devstack sudo[78608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 00:52:36 devstack sudo[78608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:52:37 devstack sudo[78608]: pam_unix(sudo:session): session closed for user root Jul 08 00:52:37 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.702s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:52:37 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:52:37 devstack sudo[78643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:52:37 devstack sudo[78643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:52:38 devstack sudo[78643]: pam_unix(sudo:session): session closed for user root Jul 08 00:52:38 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.712s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:52:38 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:52:38 devstack sudo[78646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:52:38 devstack sudo[78646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:52:38 devstack sudo[78646]: pam_unix(sudo:session): session closed for user root Jul 08 00:52:38 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.651s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:52:38 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:52:39 devstack sudo[78649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:52:39 devstack sudo[78649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:52:39 devstack sudo[78649]: pam_unix(sudo:session): session closed for user root Jul 08 00:52:39 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.697s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:52:39 devstack cinder-volume[75772]: DEBUG cinder.manager [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Notifying Schedulers of capabilities ... {{(pid=75772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 00:52:39 devstack cinder-volume[75772]: DEBUG oslo_service.periodic_task [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Running periodic task VolumeManager._thread_info {{(pid=75772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 00:52:39 devstack cinder-volume[75772]: DEBUG cinder.volume.manager [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] thread count: 6 {{(pid=75772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 00:52:39 devstack cinder-volume[75772]: DEBUG cinder.volume.manager [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] thread info: [<_MainThread(MainThread, started 139213439467648)>, , , , , ] {{(pid=75772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 00:53:36 devstack cinder-volume[75772]: DEBUG oslo_service.periodic_task [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 00:53:36 devstack cinder-volume[75772]: DEBUG cinder.volume.drivers.lvm [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Updating volume stats {{(pid=75772) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 00:53:36 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:53:36 devstack sudo[81876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 00:53:36 devstack sudo[81876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:53:37 devstack sudo[81876]: pam_unix(sudo:session): session closed for user root Jul 08 00:53:37 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.752s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:53:37 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:53:37 devstack sudo[81881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:53:37 devstack sudo[81881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:53:38 devstack sudo[81881]: pam_unix(sudo:session): session closed for user root Jul 08 00:53:38 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:53:38 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:53:38 devstack sudo[81902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:53:38 devstack sudo[81902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:53:38 devstack sudo[81902]: pam_unix(sudo:session): session closed for user root Jul 08 00:53:38 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.657s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:53:38 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:53:39 devstack sudo[81921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:53:39 devstack sudo[81921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:53:39 devstack sudo[81921]: pam_unix(sudo:session): session closed for user root Jul 08 00:53:39 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.660s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:53:39 devstack cinder-volume[75772]: DEBUG cinder.manager [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Notifying Schedulers of capabilities ... {{(pid=75772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 00:53:50 devstack cinder-volume[75772]: DEBUG dbcounter [-] [75772] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 00:54:36 devstack cinder-volume[75772]: DEBUG oslo_service.periodic_task [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 00:54:36 devstack cinder-volume[75772]: DEBUG cinder.volume.drivers.lvm [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Updating volume stats {{(pid=75772) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 00:54:36 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:54:36 devstack sudo[83701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 00:54:36 devstack sudo[83701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:54:37 devstack sudo[83701]: pam_unix(sudo:session): session closed for user root Jul 08 00:54:37 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.776s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:54:37 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:54:37 devstack sudo[83704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:54:37 devstack sudo[83704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:54:38 devstack sudo[83704]: pam_unix(sudo:session): session closed for user root Jul 08 00:54:38 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.802s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:54:38 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:54:38 devstack sudo[83731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:54:38 devstack sudo[83731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:54:39 devstack sudo[83731]: pam_unix(sudo:session): session closed for user root Jul 08 00:54:39 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.856s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:54:39 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:54:39 devstack sudo[83742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:54:39 devstack sudo[83742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:54:40 devstack sudo[83742]: pam_unix(sudo:session): session closed for user root Jul 08 00:54:40 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.960s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:54:40 devstack cinder-volume[75772]: DEBUG cinder.manager [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Notifying Schedulers of capabilities ... {{(pid=75772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 00:54:40 devstack cinder-volume[75772]: DEBUG oslo_service.periodic_task [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Running periodic task VolumeManager._thread_info {{(pid=75772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 00:54:40 devstack cinder-volume[75772]: DEBUG cinder.volume.manager [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] thread count: 6 {{(pid=75772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 00:54:40 devstack cinder-volume[75772]: DEBUG cinder.volume.manager [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] thread info: [<_MainThread(MainThread, started 139213439467648)>, , , , , ] {{(pid=75772) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 00:55:36 devstack cinder-volume[75772]: DEBUG oslo_service.periodic_task [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75772) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 00:55:36 devstack cinder-volume[75772]: DEBUG cinder.volume.drivers.lvm [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Updating volume stats {{(pid=75772) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 08 00:55:36 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:55:36 devstack sudo[85246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 08 00:55:36 devstack sudo[85246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:55:37 devstack sudo[85246]: pam_unix(sudo:session): session closed for user root Jul 08 00:55:37 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.738s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:55:37 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:55:37 devstack sudo[85252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:55:37 devstack sudo[85252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:55:38 devstack sudo[85252]: pam_unix(sudo:session): session closed for user root Jul 08 00:55:38 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.673s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:55:38 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:55:38 devstack sudo[85256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 08 00:55:38 devstack sudo[85256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:55:39 devstack sudo[85256]: pam_unix(sudo:session): session closed for user root Jul 08 00:55:39 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.712s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:55:39 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:55:39 devstack sudo[85270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 08 00:55:39 devstack sudo[85270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:55:39 devstack sudo[85270]: pam_unix(sudo:session): session closed for user root Jul 08 00:55:39 devstack cinder-volume[75772]: DEBUG oslo_concurrency.processutils [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.681s {{(pid=75772) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:55:39 devstack cinder-volume[75772]: DEBUG cinder.manager [None req-cf30e195-5ca6-487b-a94c-f4ac6f163839 None None] Notifying Schedulers of capabilities ... {{(pid=75772) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 00:55:50 devstack cinder-volume[75772]: DEBUG dbcounter [-] [75772] Writing DB stats cinder:SELECT=1 {{(pid=75772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 00:55:50 devstack cinder-volume[75772]: DEBUG dbcounter [-] [75772] Writing DB stats cinder:UPDATE=1 {{(pid=75772) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 00:56:28 devstack cinder-volume[75600]: INFO oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Caught SIGTERM, stopping children Jul 08 00:56:28 devstack cinder-volume[75600]: DEBUG oslo_concurrency.lockutils [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Acquiring lock "singleton_lock" {{(pid=75600) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 00:56:28 devstack cinder-volume[75600]: DEBUG oslo_concurrency.lockutils [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Acquired lock "singleton_lock" {{(pid=75600) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 00:56:28 devstack cinder-volume[75600]: DEBUG oslo_concurrency.lockutils [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Releasing lock "singleton_lock" {{(pid=75600) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 00:56:28 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Stop services. {{(pid=75600) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 00:56:28 devstack cinder-volume[75600]: DEBUG oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Killing children. {{(pid=75600) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 00:56:28 devstack cinder-volume[75600]: INFO oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Waiting on 1 children to exit Jul 08 00:56:32 devstack cinder-volume[75772]: DEBUG oslo_concurrency.lockutils [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Acquiring lock "singleton_lock" {{(pid=75772) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 00:56:32 devstack cinder-volume[75772]: DEBUG oslo_concurrency.lockutils [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Acquired lock "singleton_lock" {{(pid=75772) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 00:56:32 devstack cinder-volume[75772]: DEBUG oslo_concurrency.lockutils [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Releasing lock "singleton_lock" {{(pid=75772) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 00:56:32 devstack cinder-volume[75772]: WARNING amqp [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 00:56:33 devstack cinder-volume[75772]: WARNING amqp [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 00:56:33 devstack cinder-volume[75600]: INFO oslo_service.backend._eventlet.service [None req-c9aa68bc-a92f-4e35-9fb7-78758abd3e93 None None] Child 75772 exited with status 0 Jul 08 00:56:33 devstack cinder-volume[86339]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 00:56:33 devstack cinder-volume[86339]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 00:56:33 devstack cinder-volume[86339]: we strongly recommend against using it for new projects. Jul 08 00:56:33 devstack cinder-volume[86339]: If you are already using Eventlet, we recommend migrating to a different Jul 08 00:56:33 devstack cinder-volume[86339]: framework. For more detail see Jul 08 00:56:33 devstack cinder-volume[86339]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 00:56:33 devstack cinder-volume[86339]: import eventlet # noqa Jul 08 00:56:35 devstack cinder-volume[86339]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 00:56:35 devstack cinder-volume[86339]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 00:56:35 devstack cinder-volume[86339]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 00:56:36 devstack cinder-volume[86339]: INFO dbcounter [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Registered counter for database cinder Jul 08 00:56:36 devstack cinder-volume[86339]: DEBUG oslo_db.sqlalchemy.engines [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86339) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 00:56:36 devstack cinder-volume[86339]: DEBUG dbcounter [-] [86339] Writer thread running {{(pid=86339) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 00:56:36 devstack cinder-volume[86339]: INFO cinder.rpc [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 00:56:36 devstack cinder-volume[86339]: INFO cinder.rpc [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 00:56:36 devstack cinder-volume[86339]: DEBUG oslo_db.sqlalchemy.engines [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86339) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 00:56:36 devstack cinder-volume[86339]: INFO cinder.volume.manager [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Determined volume DB was empty at startup. Jul 08 00:56:36 devstack cinder-volume[86339]: DEBUG cinder.volume.manager [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86339) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 00:56:36 devstack cinder-volume[86339]: INFO cinder.volume.manager [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 08 00:56:36 devstack cinder-volume[86339]: WARNING stevedore.named [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 00:56:36 devstack cinder-volume[86339]: WARNING castellan.key_manager [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 00:56:36 devstack cinder-volume[86339]: WARNING cinder.keymgr.conf_key_mgr [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 00:56:36 devstack cinder-volume[86339]: INFO cinder.volume.manager [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_db.sqlalchemy.engines [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86339) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 00:56:37 devstack cinder-volume[86339]: INFO oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Starting 1 workers Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Started child 86551 {{(pid=86339) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Full set of CONF: {{(pid=86339) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] ******************************************************************************** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Configuration options gathered from: {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] ================================================================================ {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] allow_availability_zone_fallback = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] allow_compression_on_image_upload = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] allowed_direct_url_schemes = [] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] api_rate_limit = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86551]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] auth_strategy = keystone {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_availability_zone = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_host = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_name = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_stats_polling_interval = 60 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backup_api_class = cinder.backup.api.API {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backup_name_template = backup-%s {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backup_use_same_host = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backup_use_temp_snapshot = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] chap_password = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] chap_username = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cinder_internal_tenant_project_id = f20b495ecb70429b8dd66a84f83079de {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cinder_internal_tenant_user_id = 43adf74fc8934a7ba265d8bda3c8ecbc {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cluster = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] compression_format = gzip {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] compute_api_class = cinder.compute.nova.API {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] config_dir = [] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] config_source = [] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] control_exchange = openstack {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] debug = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] default_availability_zone = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] default_group_type = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] default_volume_type = QuobyteHD {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] disk_geometry = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] driver_client_cert = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] driver_client_cert_key = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] driver_data_namespace = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] driver_ssl_cert_path = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] driver_ssl_cert_verify = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] driver_use_ssl = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] enable_new_services = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] enable_unsupported_driver = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] enabled_backends = ['QuobyteHD'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] enforce_multipath_for_image_xfer = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] filter_function = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] glance_api_insecure = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] glance_api_servers = ['http://192.168.122.200/image'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] glance_api_ssl_compression = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] glance_ca_certificates_file = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] glance_catalog_info = image:glance:publicURL {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] glance_certfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] glance_keyfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] glance_num_retries = 3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] glance_request_timeout = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] goodness_function = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] graceful_shutdown_timeout = 5 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] group_api_class = cinder.group.api.API {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] host = devstack {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] image_compress_on_upload = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] image_conversion_address_space_limit = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] image_conversion_cpu_limit = 60 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] image_conversion_disable = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] image_upload_use_cinder_backend = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] image_upload_use_internal_tenant = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] image_volume_cache_enabled = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] image_volume_cache_max_count = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] image_volume_cache_max_size_gb = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] init_host_max_objects_retrieval = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] instance_format = [instance: %(uuid)s] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] iscsi_target_flags = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] iscsi_write_cache = on {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] iser_helper = tgtadm {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] iser_ip_address = 192.168.122.200 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] iser_port = 3260 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] log_color = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] log_config_append = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] log_dir = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] log_file = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] log_options = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] log_rotate_interval = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] log_rotate_interval_type = days {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] log_rotation_type = none {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] max_age = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] max_logfile_count = 30 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] max_logfile_size_mb = 200 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] max_over_subscription_ratio = 20.0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] message_reap_interval = 86400 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] message_ttl = 2592000 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] migration_create_volume_timeout_secs = 300 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] monkey_patch = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] monkey_patch_modules = [] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] my_ip = 192.168.122.200 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] no_snapshot_gb_quota = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] num_iser_scan_tries = 3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] num_shell_tries = 3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] num_volume_device_scan_tries = 3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] nvmeof_conn_info_version = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] nvmet_ns_id = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] nvmet_port_id = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] osapi_max_limit = 1000 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] osapi_volume_ext_list = [] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] osapi_volume_listen_port = 8776 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] osapi_volume_use_ssl = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] osapi_volume_workers = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] per_volume_size_limit = -1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] periodic_fuzzy_delay = 60 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] periodic_interval = 60 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] public_endpoint = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] publish_errors = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86551]: INFO cinder.volume.manager [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 00:56:37 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.remotefs [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86551) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] quota_backup_gigabytes = 1000 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] quota_backups = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] quota_gigabytes = 1000 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] quota_groups = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] quota_snapshots = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] quota_volumes = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] rate_limit_burst = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] rate_limit_except_level = CRITICAL {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] rate_limit_interval = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] reinit_driver_count = 3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] replication_device = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] report_discard_supported = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] report_interval = 120 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] reservation_clean_interval = 86400 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] reservation_expire = 86400 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] reserved_image_namespaces = [] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] reserved_percentage = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] rpc_response_timeout = 120 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] run_external_periodic_tasks = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] scst_target_driver = iscsi {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] scst_target_iqn_name = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] service_down_time = 720 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] shell_completion = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] snapshot_name_template = snapshot-%s {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] split_loggers = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] state_path = /opt/stack/data/cinder {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] storage_availability_zone = nova {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] storage_protocol = iSCSI {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] syslog_log_facility = LOG_USER {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] target_helper = lioadm {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] target_ip_address = 192.168.122.200 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] target_port = 3260 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] target_protocol = iscsi {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] target_secondary_ip_addresses = [] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] trace_flags = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] transport_url = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] until_refresh = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] use_chap_auth = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] use_default_quota_class = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] use_journal = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] use_json = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] use_multipath_for_image_xfer = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] use_stderr = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] use_syslog = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] verify_glance_signatures = enabled {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] volume_api_class = cinder.volume.api.API {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] volume_backend_name = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] volume_clear = zero {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] volume_clear_ionice = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] volume_clear_size = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] volume_copy_bps_limit = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] volume_dd_blocksize = 1M {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] volume_name_template = volume-%s {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] volume_service_inithost_offload = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] volume_usage_audit_period = month {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] zoning_mode = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_concurrency.disable_process_locking = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.auth_section = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.auth_type = password {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.auth_version = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.cache = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.certfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.include_service_catalog = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.insecure = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.interface = public {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.keyfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.memcache_password = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.memcache_username = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.region_name = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.service_type = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.200/identity {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.backend = dogpile.cache.null {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.backend_argument = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.backend_expiration_time = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.config_prefix = cache.oslo {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.debug_cache_backend = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.enable_retry_client = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.enable_socket_keepalive = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.enabled = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.expiration_time = 600 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.hashclient_retry_attempts = 2 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.memcache_dead_retry = 300 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.memcache_pool_maxsize = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.memcache_sasl_enabled = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.password = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.proxies = [] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.redis_db = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.redis_server = localhost:6379 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.retry_attempts = 2 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.retry_delay = 0.0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.socket_keepalive_count = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.socket_keepalive_idle = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.socket_keepalive_interval = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.socket_timeout = 1.0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.tls_allowed_ciphers = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.tls_cafile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.tls_certfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.tls_enabled = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.tls_keyfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cache.username = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] coordination.backend_url = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.asyncio_connection = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.asyncio_slave_connection = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.backend = sqlalchemy {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.connection = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.connection_debug = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.connection_parameters = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.connection_recycle_time = 3600 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.connection_trace = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.db_inc_retry_interval = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.db_max_retries = 20 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.db_max_retry_interval = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.db_retry_interval = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.max_overflow = 50 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.max_pool_size = 5 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.max_retries = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.mysql_wsrep_sync_wait = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.pool_timeout = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.retry_interval = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.slave_connection = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.sqlite_synchronous = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.synchronous_reader = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] database.use_db_reconnect = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] profiler.connection_string = messaging:// {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] profiler.enabled = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] profiler.es_doc_type = notification {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] profiler.es_scroll_size = 10000 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] profiler.es_scroll_time = 2m {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] profiler.filter_error_trace = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] profiler.hmac_keys = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] profiler.sentinel_service_name = mymaster {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] profiler.socket_timeout = 0.1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] profiler.trace_requests = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] profiler.trace_sqlalchemy = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] profiler_jaeger.process_tags = {} {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] profiler_jaeger.service_name_prefix = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] profiler_otlp.service_name_prefix = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_policy.enforce_new_defaults = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_policy.enforce_scope = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_policy.policy_default_rule = default {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_policy.policy_file = policy.yaml {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] privsep_osbrick.group = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] privsep_osbrick.helper_command = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] privsep_osbrick.user = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cinder_sys_admin.group = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cinder_sys_admin.helper_command = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] cinder_sys_admin.user = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] service_user.auth_section = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] service_user.auth_type = password {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] service_user.cafile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] service_user.certfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] service_user.collect_timing = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] service_user.insecure = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] service_user.keyfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] service_user.send_service_user_token = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] service_user.split_loggers = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] service_user.timeout = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] glance.auth_section = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] glance.auth_type = password {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] glance.certfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] glance.collect_timing = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] glance.insecure = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] glance.keyfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] glance.region_name = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] glance.split_loggers = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] glance.timeout = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.backend_availability_zone = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.chap_password = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.chap_username = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.disk_geometry = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.driver_client_cert = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.driver_client_cert_key = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.driver_data_namespace = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.driver_use_ssl = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.extra_capabilities = {} {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.filter_function = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.goodness_function = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.iscsi_target_flags = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.iscsi_write_cache = on {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.iser_helper = tgtadm {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.iser_ip_address = 192.168.122.200 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.iser_port = 3260 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.nas_host = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.nas_login = admin {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.nas_mount_options = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.nas_password = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.nas_private_key = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.nas_share_path = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.num_shell_tries = 3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.quobyte_volume_url = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.replication_device = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.report_discard_supported = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.reserved_percentage = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.target_helper = tgtadm {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.target_ip_address = 192.168.122.200 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.target_port = 3260 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.target_protocol = iscsi {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.trace_flags = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.unique_fqdn_network = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.use_chap_auth = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.volume_backend_name = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86551) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 00:56:37 devstack cinder-volume[86551]: WARNING cinder.volume.drivers.quobyte [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.volume_clear = zero {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.volume_clear_ionice = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.volume_clear_size = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86551]: WARNING cinder.volume.drivers.quobyte [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_reports.file_event_handler = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_reports.log_dir = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.backend_availability_zone = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Running cmd (subprocess): mount.quobyte {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.backend_host = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.chap_password = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.chap_username = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.chiscsi_conf = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.disk_geometry = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.driver_client_cert = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.driver_data_namespace = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.driver_use_ssl = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.extra_capabilities = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.filter_function = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.goodness_function = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.iser_helper = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.iser_ip_address = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.iser_port = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.iser_target_prefix = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.nas_host = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.nas_login = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.nas_mount_options = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.nas_password = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.nas_private_key = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.nas_share_path = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.nas_ssh_port = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.num_shell_tries = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.nvmet_port_id = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.replication_device = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.report_discard_supported = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.reserved_percentage = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.scst_target_driver = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.storage_protocol = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.target_helper = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.target_ip_address = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.target_port = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.target_prefix = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.target_protocol = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.trace_flags = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.use_chap_auth = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.volume_clear = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.volume_clear_size = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] QuobyteHD.volumes_dir = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.ssl = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_notifications.driver = [] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_notifications.retry = -1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] key_manager.fixed_key = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican.barbican_api_version = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican.barbican_endpoint = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican.barbican_endpoint_type = public {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican.barbican_region_name = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican.cafile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican.certfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican.collect_timing = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican.insecure = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican.keyfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican.number_of_retries = 60 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican.retry_delay = 1 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican.send_service_user_token = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican.split_loggers = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican.timeout = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican.verify_ssl = True {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican.verify_ssl_path = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican_service_user.auth_section = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican_service_user.auth_type = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican_service_user.cafile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican_service_user.certfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican_service_user.collect_timing = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican_service_user.insecure = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican_service_user.keyfile = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican_service_user.split_loggers = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] barbican_service_user.timeout = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] vault.approle_role_id = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] vault.approle_secret_id = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] vault.kv_mountpoint = secret {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] vault.kv_path = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] vault.kv_version = 2 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] vault.namespace = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] vault.root_token_id = **** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] vault.ssl_ca_crt_file = None {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] vault.timeout = 60.0 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] vault.use_ssl = False {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:37 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] ******************************************************************************** {{(pid=86339) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 00:56:37 devstack quobyte-client[86556]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 00:56:37 devstack quobyte-client[86556]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 00:56:37 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] CMD "mount.quobyte" returned: 1 in 0.115s {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:56:37 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:56:37 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:56:37 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=86551) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 00:56:37 devstack cinder-volume[86551]: INFO cinder.volume.drivers.quobyte [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e ... Jul 08 00:56:37 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 -c /etc/quobyte/client-cinder.cfg {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:56:37 devstack sudo[86557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 -c /etc/quobyte/client-cinder.cfg Jul 08 00:56:37 devstack sudo[86557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:56:38 devstack sudo[86557]: pam_unix(sudo:session): session closed for user root Jul 08 00:56:38 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.754s {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:56:38 devstack cinder-volume[86551]: INFO cinder.volume.drivers.quobyte [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e succeeded Jul 08 00:56:38 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=86551) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 00:56:38 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.766s {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:56:38 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:56:38 devstack sudo[86626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 00:56:38 devstack sudo[86626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:56:38 devstack sudo[86626]: pam_unix(sudo:session): session closed for user root Jul 08 00:56:38 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.663s {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:56:38 devstack cinder-volume[86551]: INFO cinder.volume.driver [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Driver hasn't implemented _init_vendor_properties() Jul 08 00:56:38 devstack cinder-volume[86551]: DEBUG cinder.volume.driver [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6468620300293, 'free_capacity_gb': 1775.6468620300293, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86551) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 00:56:39 devstack cinder-volume[86551]: DEBUG oslo_db.sqlalchemy.engines [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 00:56:39 devstack cinder-volume[86551]: DEBUG dbcounter [-] [86551] Writer thread running {{(pid=86551) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 00:56:39 devstack cinder-volume[86551]: DEBUG cinder.db.api [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Building query based on filter {{(pid=86551) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 00:56:39 devstack cinder-volume[86551]: DEBUG cinder.image.image_utils [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86551) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 00:56:39 devstack cinder-volume[86551]: INFO cinder.keymgr.migration [None req-367cb538-41bb-407f-9ded-a5cba6baa488 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 00:56:39 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:56:39 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:56:39 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=86551) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 00:56:39 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=86551) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 00:56:39 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:56:39 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:56:39 devstack sudo[86646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 00:56:39 devstack sudo[86646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:56:40 devstack sudo[86646]: pam_unix(sudo:session): session closed for user root Jul 08 00:56:40 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.064s {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:56:40 devstack cinder-volume[86551]: DEBUG cinder.manager [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Notifying Schedulers of capabilities ... {{(pid=86551) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 00:56:40 devstack cinder-volume[86551]: INFO cinder.volume.manager [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Driver initialization completed successfully. Jul 08 00:56:40 devstack cinder-volume[86551]: INFO cinder.manager [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Initiating service 3 cleanup Jul 08 00:56:40 devstack cinder-volume[86551]: INFO cinder.manager [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Service 3 cleanup completed. Jul 08 00:56:40 devstack cinder-volume[86551]: DEBUG cinder.service [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Creating RPC server for service cinder-volume {{(pid=86551) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 00:56:40 devstack cinder-volume[86551]: DEBUG cinder.service [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86551) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 00:56:40 devstack cinder-volume[86551]: INFO cinder.volume.manager [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 00:56:40 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:56:40 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:56:40 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=86551) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 00:56:40 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=86551) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 00:56:40 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:56:40 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:56:40 devstack sudo[86742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 00:56:40 devstack sudo[86742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:56:41 devstack sudo[86742]: pam_unix(sudo:session): session closed for user root Jul 08 00:56:41 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.766s {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:56:41 devstack cinder-volume[86551]: INFO cinder.volume.manager [None req-5100b4b4-888a-4610-b3c6-86bf7cd9aaef None None] Driver post RPC initialization completed successfully. Jul 08 00:56:43 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-8e722498-a3a1-4db3-816a-d6f7d8356ee7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:56:43 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-8e722498-a3a1-4db3-816a-d6f7d8356ee7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:56:43 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-8e722498-a3a1-4db3-816a-d6f7d8356ee7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=86551) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 00:56:43 devstack cinder-volume[86551]: DEBUG cinder.volume.drivers.quobyte [None req-8e722498-a3a1-4db3-816a-d6f7d8356ee7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=86551) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 00:56:43 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-8e722498-a3a1-4db3-816a-d6f7d8356ee7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86551) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:56:43 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-8e722498-a3a1-4db3-816a-d6f7d8356ee7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:56:43 devstack sudo[86754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 00:56:43 devstack sudo[86754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:56:44 devstack sudo[86754]: pam_unix(sudo:session): session closed for user root Jul 08 00:56:44 devstack cinder-volume[86551]: DEBUG oslo_concurrency.processutils [None req-8e722498-a3a1-4db3-816a-d6f7d8356ee7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.707s {{(pid=86551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:56:44 devstack cinder-volume[86551]: DEBUG cinder.manager [None req-8e722498-a3a1-4db3-816a-d6f7d8356ee7 None None] Notifying Schedulers of capabilities ... {{(pid=86551) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 00:56:45 devstack cinder-volume[86339]: INFO oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Caught SIGTERM, stopping children Jul 08 00:56:45 devstack cinder-volume[86339]: DEBUG oslo_concurrency.lockutils [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Acquiring lock "singleton_lock" {{(pid=86339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 00:56:45 devstack cinder-volume[86339]: DEBUG oslo_concurrency.lockutils [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Acquired lock "singleton_lock" {{(pid=86339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 00:56:45 devstack cinder-volume[86339]: DEBUG oslo_concurrency.lockutils [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Releasing lock "singleton_lock" {{(pid=86339) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 00:56:45 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Stop services. {{(pid=86339) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 08 00:56:45 devstack cinder-volume[86339]: DEBUG oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Killing children. {{(pid=86339) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 08 00:56:45 devstack cinder-volume[86339]: INFO oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Waiting on 1 children to exit Jul 08 00:56:48 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Acquiring lock "singleton_lock" {{(pid=86551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 00:56:48 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Acquired lock "singleton_lock" {{(pid=86551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 00:56:48 devstack cinder-volume[86551]: DEBUG oslo_concurrency.lockutils [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Releasing lock "singleton_lock" {{(pid=86551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 00:56:48 devstack cinder-volume[86551]: WARNING amqp [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 00:56:48 devstack cinder-volume[86551]: WARNING amqp [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 08 00:56:48 devstack cinder-volume[86339]: INFO oslo_service.backend._eventlet.service [None req-b251d4a9-b8a5-4bfe-b056-2bd5ef09d5f5 None None] Child 86551 exited with status 0 Jul 08 00:56:49 devstack cinder-volume[86834]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 08 00:56:49 devstack cinder-volume[86834]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 00:56:49 devstack cinder-volume[86834]: we strongly recommend against using it for new projects. Jul 08 00:56:49 devstack cinder-volume[86834]: If you are already using Eventlet, we recommend migrating to a different Jul 08 00:56:49 devstack cinder-volume[86834]: framework. For more detail see Jul 08 00:56:49 devstack cinder-volume[86834]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 00:56:49 devstack cinder-volume[86834]: import eventlet # noqa Jul 08 00:56:52 devstack cinder-volume[86834]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86834) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 08 00:56:52 devstack cinder-volume[86834]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86834) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 08 00:56:52 devstack cinder-volume[86834]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86834) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 08 00:56:53 devstack cinder-volume[86834]: INFO dbcounter [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] Registered counter for database cinder Jul 08 00:56:53 devstack cinder-volume[86834]: DEBUG oslo_db.sqlalchemy.engines [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86834) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 00:56:53 devstack cinder-volume[86834]: DEBUG dbcounter [-] [86834] Writer thread running {{(pid=86834) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 00:56:53 devstack cinder-volume[86834]: INFO cinder.rpc [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 08 00:56:53 devstack cinder-volume[86834]: INFO cinder.rpc [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 08 00:56:53 devstack cinder-volume[86834]: DEBUG oslo_db.sqlalchemy.engines [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86834) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 00:56:53 devstack cinder-volume[86834]: INFO cinder.volume.manager [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] Determined volume DB was empty at startup. Jul 08 00:56:53 devstack cinder-volume[86834]: DEBUG cinder.volume.manager [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86834) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 08 00:56:53 devstack cinder-volume[86834]: WARNING stevedore.named [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 08 00:56:53 devstack cinder-volume[86834]: WARNING castellan.key_manager [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 00:56:53 devstack cinder-volume[86834]: WARNING cinder.keymgr.conf_key_mgr [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 08 00:56:53 devstack cinder-volume[86834]: INFO cinder.volume.manager [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_db.sqlalchemy.engines [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86834) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 00:56:54 devstack cinder-volume[86834]: INFO oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] Starting 1 workers Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] Started child 87123 {{(pid=86834) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] Full set of CONF: {{(pid=86834) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] ******************************************************************************** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] Configuration options gathered from: {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] ================================================================================ {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] allow_availability_zone_fallback = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] allow_compression_on_image_upload = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] allowed_direct_url_schemes = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] api_rate_limit = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] auth_strategy = keystone {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_availability_zone = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_host = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_stats_polling_interval = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backup_api_class = cinder.backup.api.API {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[87123]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backup_name_template = backup-%s {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backup_use_same_host = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backup_use_temp_snapshot = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] chap_password = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] chap_username = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cinder_internal_tenant_project_id = f20b495ecb70429b8dd66a84f83079de {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cinder_internal_tenant_user_id = 43adf74fc8934a7ba265d8bda3c8ecbc {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cluster = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] compression_format = gzip {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] compute_api_class = cinder.compute.nova.API {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] config_dir = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] config_source = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] control_exchange = openstack {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] debug = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] default_availability_zone = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] default_group_type = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] default_volume_type = QuobyteHD {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] disk_geometry = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] driver_client_cert = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] driver_client_cert_key = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] driver_data_namespace = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] driver_ssl_cert_path = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] driver_ssl_cert_verify = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] driver_use_ssl = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] enable_new_services = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] enable_unsupported_driver = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] enabled_backends = ['QuobyteHD'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] enforce_multipath_for_image_xfer = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] filter_function = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] glance_api_insecure = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] glance_api_servers = ['http://192.168.122.200/image'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] glance_api_ssl_compression = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] glance_ca_certificates_file = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] glance_catalog_info = image:glance:publicURL {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] glance_certfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] glance_keyfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] glance_num_retries = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] glance_request_timeout = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] goodness_function = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] graceful_shutdown_timeout = 5 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] group_api_class = cinder.group.api.API {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] host = devstack {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] image_compress_on_upload = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] image_conversion_address_space_limit = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] image_conversion_cpu_limit = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] image_conversion_disable = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] image_upload_use_cinder_backend = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] image_upload_use_internal_tenant = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] image_volume_cache_enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] image_volume_cache_max_count = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] image_volume_cache_max_size_gb = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] init_host_max_objects_retrieval = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] instance_format = [instance: %(uuid)s] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] iscsi_target_flags = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] iscsi_write_cache = on {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] iser_helper = tgtadm {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] iser_ip_address = 192.168.122.200 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] iser_port = 3260 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] log_color = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] log_config_append = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] log_dir = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] log_file = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] log_options = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] log_rotate_interval = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] log_rotate_interval_type = days {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] log_rotation_type = none {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] max_age = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] max_logfile_count = 30 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] max_logfile_size_mb = 200 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] max_over_subscription_ratio = 20.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] message_reap_interval = 86400 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] message_ttl = 2592000 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] migration_create_volume_timeout_secs = 300 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] monkey_patch = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] monkey_patch_modules = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] my_ip = 192.168.122.200 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] no_snapshot_gb_quota = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] num_iser_scan_tries = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] num_shell_tries = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] num_volume_device_scan_tries = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] nvmeof_conn_info_version = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] nvmet_ns_id = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] nvmet_port_id = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] osapi_max_limit = 1000 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] osapi_volume_ext_list = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] osapi_volume_listen = 0.0.0.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] osapi_volume_listen_port = 8776 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] osapi_volume_use_ssl = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] osapi_volume_workers = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] per_volume_size_limit = -1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] periodic_fuzzy_delay = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] periodic_interval = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] project_id_regex = [0-9a-f\-]+ {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] public_endpoint = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] publish_errors = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] quota_backup_gigabytes = 1000 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] quota_backups = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] quota_gigabytes = 1000 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] quota_groups = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] quota_snapshots = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] quota_volumes = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] rate_limit_burst = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] rate_limit_except_level = CRITICAL {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Starting volume driver QuobyteDriver (1.1.14) Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] rate_limit_interval = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87123) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] reinit_driver_count = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] replication_device = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] report_discard_supported = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] report_interval = 120 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] reservation_clean_interval = 86400 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] reservation_expire = 86400 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] reserved_image_namespaces = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] reserved_percentage = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] rpc_response_timeout = 120 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] run_external_periodic_tasks = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] scst_target_driver = iscsi {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] scst_target_iqn_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] service_down_time = 720 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] shell_completion = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] snapshot_name_template = snapshot-%s {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] split_loggers = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] state_path = /opt/stack/data/cinder {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] storage_availability_zone = nova {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] storage_protocol = iSCSI {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] syslog_log_facility = LOG_USER {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] target_helper = lioadm {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] target_ip_address = 192.168.122.200 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] target_port = 3260 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] target_protocol = iscsi {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] target_secondary_ip_addresses = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] trace_flags = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] transfer_api_class = cinder.transfer.api.API {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] transport_url = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] until_refresh = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] use_chap_auth = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] use_default_quota_class = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] use_journal = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] use_json = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] use_multipath_for_image_xfer = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] use_stderr = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] use_syslog = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] verify_glance_signatures = enabled {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] volume_api_class = cinder.volume.api.API {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] volume_backend_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] volume_clear = zero {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] volume_clear_ionice = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] volume_clear_size = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] volume_copy_bps_limit = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] volume_dd_blocksize = 1M {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] volume_name_template = volume-%s {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] volume_service_inithost_offload = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] volume_usage_audit_period = month {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] zoning_mode = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_concurrency.disable_process_locking = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.auth_section = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.auth_type = password {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.auth_version = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.cache = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.certfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.delay_auth_decision = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.http_connect_timeout = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.include_service_catalog = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.insecure = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.interface = public {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.keyfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.memcache_password = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.memcache_username = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.region_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.service_token_roles_required = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.service_type = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.token_cache_time = 300 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.200/identity {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.backend = dogpile.cache.null {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.backend_argument = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.backend_expiration_time = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.config_prefix = cache.oslo {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.debug_cache_backend = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.enable_retry_client = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.enable_socket_keepalive = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.expiration_time = 600 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.hashclient_retry_attempts = 2 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.memcache_dead_retry = 300 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.memcache_pool_maxsize = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.memcache_sasl_enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.password = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.proxies = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.redis_db = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.redis_sentinel_service_name = mymaster {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.redis_server = localhost:6379 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.retry_attempts = 2 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.retry_delay = 0.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.socket_keepalive_count = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.socket_keepalive_idle = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.socket_keepalive_interval = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.socket_timeout = 1.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.tls_allowed_ciphers = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.tls_cafile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.tls_certfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.tls_enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.tls_keyfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cache.username = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] coordination.backend_url = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.asyncio_connection = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.asyncio_slave_connection = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.backend = sqlalchemy {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.connection = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.connection_debug = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.connection_parameters = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.connection_recycle_time = 3600 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.connection_trace = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.db_inc_retry_interval = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.db_max_retries = 20 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.db_max_retry_interval = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.db_retry_interval = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.max_overflow = 50 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.max_pool_size = 5 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.max_retries = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.mysql_wsrep_sync_wait = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.pool_timeout = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.retry_interval = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.slave_connection = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.sqlite_synchronous = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.synchronous_reader = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] database.use_db_reconnect = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] profiler.connection_string = messaging:// {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] profiler.enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] profiler.es_doc_type = notification {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] profiler.es_scroll_size = 10000 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] profiler.es_scroll_time = 2m {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] profiler.filter_error_trace = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] profiler.hmac_keys = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] profiler.sentinel_service_name = mymaster {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] profiler.socket_timeout = 0.1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] profiler.trace_requests = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] profiler.trace_sqlalchemy = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] profiler_jaeger.process_tags = {} {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] profiler_jaeger.service_name_prefix = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] profiler_otlp.service_name_prefix = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_policy.enforce_new_defaults = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_policy.enforce_scope = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_policy.policy_default_rule = default {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_policy.policy_file = policy.yaml {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_policy.remote_timeout = 60.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] privsep_osbrick.group = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] privsep_osbrick.helper_command = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87123) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 08 00:56:54 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.quobyte [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 08 00:56:54 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.quobyte [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] privsep_osbrick.user = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cinder_sys_admin.group = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cinder_sys_admin.helper_command = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Running cmd (subprocess): mount.quobyte {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] cinder_sys_admin.user = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] service_user.auth_section = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] service_user.auth_type = password {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] service_user.cafile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] service_user.certfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] service_user.collect_timing = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] service_user.insecure = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] service_user.keyfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] service_user.send_service_user_token = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] service_user.split_loggers = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] service_user.timeout = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] glance.auth_section = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] glance.auth_type = password {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] glance.certfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] glance.collect_timing = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] glance.insecure = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] glance.keyfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] glance.region_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] glance.split_loggers = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] glance.timeout = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.backend_availability_zone = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.chap_password = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.chap_username = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.disk_geometry = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.driver_client_cert = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.driver_client_cert_key = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.driver_data_namespace = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.driver_use_ssl = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.enable_unsupported_driver = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.extra_capabilities = {} {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.filter_function = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.goodness_function = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.iscsi_target_flags = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.iscsi_write_cache = on {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.iser_helper = tgtadm {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.iser_ip_address = 192.168.122.200 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.iser_port = 3260 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.nas_host = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.nas_login = admin {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.nas_mount_options = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.nas_password = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.nas_private_key = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.nas_share_path = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.nas_ssh_port = 22 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.num_shell_tries = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.nvmet_port_id = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.quobyte_client_cfg = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.quobyte_volume_url = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.replication_device = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.report_discard_supported = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.reserved_percentage = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.scst_target_driver = iscsi {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.scst_target_iqn_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.storage_protocol = iSCSI {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.target_helper = tgtadm {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.target_ip_address = 192.168.122.200 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.target_port = 3260 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.target_protocol = iscsi {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.trace_flags = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.unique_fqdn_network = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.use_chap_auth = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.volume_backend_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.volume_clear = zero {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.volume_clear_ionice = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.volume_clear_size = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_reports.file_event_handler = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_reports.log_dir = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.backend_availability_zone = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.backend_host = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.chap_password = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.chap_username = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.chiscsi_conf = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.disk_geometry = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.driver_client_cert = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.driver_client_cert_key = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.driver_data_namespace = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.driver_use_ssl = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.extra_capabilities = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.filter_function = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.goodness_function = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.iscsi_target_flags = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.iscsi_write_cache = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.iser_helper = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.iser_ip_address = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.iser_port = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.iser_target_prefix = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.nas_host = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.nas_login = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.nas_mount_options = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.nas_password = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.nas_private_key = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.nas_share_path = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.nas_ssh_port = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.num_shell_tries = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.nvmet_ns_id = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.nvmet_port_id = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.replication_device = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.report_discard_supported = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.reserved_percentage = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.scst_target_driver = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.storage_protocol = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.target_helper = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.target_ip_address = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.target_port = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.target_prefix = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.target_protocol = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.trace_flags = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.unique_fqdn_network = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.use_chap_auth = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.volume_clear = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.volume_clear_ionice = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.volume_clear_size = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] QuobyteHD.volumes_dir = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack quobyte-client[87126]: Reading configuration file: /etc/quobyte/client.cfg Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.ssl = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack quobyte-client[87126]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.ssl_version = {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_notifications.driver = [] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_notifications.retry = -1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] oslo_messaging_notifications.transport_url = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] key_manager.fixed_key = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican.barbican_api_version = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican.barbican_endpoint = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] CMD "mount.quobyte" returned: 1 in 0.091s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican.barbican_endpoint_type = public {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican.barbican_region_name = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican.cafile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican.certfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican.collect_timing = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican.insecure = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican.keyfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican.number_of_retries = 60 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican.retry_delay = 1 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican.send_service_user_token = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican.split_loggers = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican.timeout = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican.verify_ssl = True {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican.verify_ssl_path = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican_service_user.auth_section = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican_service_user.auth_type = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican_service_user.cafile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican_service_user.certfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican_service_user.collect_timing = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican_service_user.insecure = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican_service_user.keyfile = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican_service_user.split_loggers = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] barbican_service_user.timeout = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] vault.approle_role_id = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] vault.approle_secret_id = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] vault.kv_mountpoint = secret {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] vault.kv_path = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] vault.kv_version = 2 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] vault.namespace = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] vault.root_token_id = **** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] vault.ssl_ca_crt_file = None {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] vault.timeout = 60.0 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] vault.use_ssl = False {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 08 00:56:54 devstack cinder-volume[86834]: DEBUG oslo_service.backend._eventlet.service [None req-aa101448-e0c5-445c-a09c-82d2eabb897e None None] ******************************************************************************** {{(pid=86834) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 08 00:56:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 00:56:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:56:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:56:54 devstack sudo[87133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 00:56:54 devstack sudo[87133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:56:54 devstack sudo[87133]: pam_unix(sudo:session): session closed for user root Jul 08 00:56:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.691s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:56:54 devstack cinder-volume[87123]: INFO cinder.volume.driver [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Driver hasn't implemented _init_vendor_properties() Jul 08 00:56:54 devstack cinder-volume[87123]: DEBUG cinder.volume.driver [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6468620300293, 'free_capacity_gb': 1775.6468620300293, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87123) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 08 00:56:55 devstack cinder-volume[87123]: DEBUG oslo_db.sqlalchemy.engines [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87123) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 08 00:56:55 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writer thread running {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 08 00:56:55 devstack cinder-volume[87123]: DEBUG cinder.db.api [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Building query based on filter {{(pid=87123) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 08 00:56:55 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87123) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 08 00:56:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:56:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:56:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 00:56:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 00:56:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:56:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:56:55 devstack cinder-volume[87123]: INFO cinder.keymgr.migration [None req-08f125e8-f507-4ead-bc04-af1f689f92f1 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 08 00:56:55 devstack sudo[87154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 00:56:55 devstack sudo[87154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:56:55 devstack sudo[87154]: pam_unix(sudo:session): session closed for user root Jul 08 00:56:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.749s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:56:55 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 00:56:55 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Driver initialization completed successfully. Jul 08 00:56:55 devstack cinder-volume[87123]: INFO cinder.manager [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Initiating service 3 cleanup Jul 08 00:56:55 devstack cinder-volume[87123]: INFO cinder.manager [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Service 3 cleanup completed. Jul 08 00:56:55 devstack cinder-volume[87123]: DEBUG cinder.service [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Creating RPC server for service cinder-volume {{(pid=87123) start /opt/stack/cinder/cinder/service.py:231}} Jul 08 00:56:55 devstack cinder-volume[87123]: DEBUG cinder.service [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87123) start /opt/stack/cinder/cinder/service.py:237}} Jul 08 00:56:56 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 08 00:56:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:56:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:56:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 00:56:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 00:56:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:56:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:56:56 devstack sudo[87173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 00:56:56 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:56:56 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root Jul 08 00:56:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.785s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:56:56 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-734869ad-c18a-4573-b797-cefd3dec59be None None] Driver post RPC initialization completed successfully. Jul 08 00:57:04 devstack cinder-volume[86834]: DEBUG dbcounter [-] [86834] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86834) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 00:57:05 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=3 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 00:57:06 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 00:57:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 00:57:44 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 6 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 00:57:44 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 00:57:53 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 00:57:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Flow 'volume_create_manager' (f0970810-5442-4f68-b967-ef434def76df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 00:57:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b45a2b-8cf4-4961-8fe7-838ab2c4d17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:57:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98b45a2b-8cf4-4961-8fe7-838ab2c4d17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T22:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1474658900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79899ecd-af34-4d25-b891-1a3078581c90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='717499d7164642f6bd40f9e0e8f21ec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T22:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T22:57:53Z,use_quota=True,user_id='e6f45066c5714f4dac7328b132291d73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:57:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164307a9-4f6f-4b66-a7ff-c445ed8d6694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:57:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164307a9-4f6f-4b66-a7ff-c445ed8d6694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:57:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1afcda-71f7-4f65-af6f-c32ce861a581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:57:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1afcda-71f7-4f65-af6f-c32ce861a581) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79899ecd-af34-4d25-b891-1a3078581c90', 'volume_name': 'volume-79899ecd-af34-4d25-b891-1a3078581c90', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:57:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ed2578-ce3b-4e79-81c1-0c9d6b6f1fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:57:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22ed2578-ce3b-4e79-81c1-0c9d6b6f1fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:57:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682e5209-e77c-488e-9a6d-c9d0fb9b3776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:57:53 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Volume 79899ecd-af34-4d25-b891-1a3078581c90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79899ecd-af34-4d25-b891-1a3078581c90', 'volume_size': 1} Jul 08 00:57:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:57:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:57:53 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T22:57:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1474658900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79899ecd-af34-4d25-b891-1a3078581c90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='717499d7164642f6bd40f9e0e8f21ec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T22:57:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T22:57:53Z,use_quota=True,user_id='e6f45066c5714f4dac7328b132291d73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 00:57:53 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Creating volume 79899ecd-af34-4d25-b891-1a3078581c90 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 00:57:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:57:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:57:53 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 00:57:53 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 00:57:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:57:53 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 00:57:53 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 00:57:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-79899ecd-af34-4d25-b891-1a3078581c90 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:57:53 devstack sudo[87462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-79899ecd-af34-4d25-b891-1a3078581c90 1073741824 Jul 08 00:57:53 devstack sudo[87462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:57:54 devstack sudo[87462]: pam_unix(sudo:session): session closed for user root Jul 08 00:57:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-79899ecd-af34-4d25-b891-1a3078581c90 1073741824" returned: 0 in 1.412s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:57:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-79899ecd-af34-4d25-b891-1a3078581c90 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:57:54 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-79899ecd-af34-4d25-b891-1a3078581c90 Jul 08 00:57:54 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:57:55 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Jul 08 00:57:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-79899ecd-af34-4d25-b891-1a3078581c90" returned: 0 in 0.837s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:57:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] <== create_volume: return (2319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 00:57:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.324s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:57:55 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682e5209-e77c-488e-9a6d-c9d0fb9b3776) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79899ecd-af34-4d25-b891-1a3078581c90', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:57:55 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81298cd8-41db-4411-abf4-cfcec3bd3b95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:57:55 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Volume volume-79899ecd-af34-4d25-b891-1a3078581c90 (79899ecd-af34-4d25-b891-1a3078581c90): created successfully Jul 08 00:57:55 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81298cd8-41db-4411-abf4-cfcec3bd3b95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:57:55 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Flow 'volume_create_manager' (f0970810-5442-4f68-b967-ef434def76df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 00:57:55 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-2f46384f-3034-463b-9b40-3fd3ff602591 tempest-TaggedAttachmentsTest-1584690808 None] Created volume successfully. Jul 08 00:58:05 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 00:58:05 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:DELETE=1 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 00:58:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 00:58:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:58:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:58:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 00:58:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 00:58:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:58:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:44 devstack sudo[88386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 00:58:44 devstack sudo[88386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:46 devstack sudo[88386]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.734s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:46 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 00:58:46 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 00:58:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 6 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 00:58:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 00:58:47 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 00:58:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Flow 'volume_create_manager' (c8916025-225c-44c1-af2b-48d9c8d2ea85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 00:58:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e49ca4e2-5300-4e79-9ad5-3b7d37f5c655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:58:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e49ca4e2-5300-4e79-9ad5-3b7d37f5c655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T22:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1536292057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0336043b-b8e1-44e6-b3d1-decff101b57e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711c3a98b6da4246b195ff8b1f1ef6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T22:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T22:58:48Z,use_quota=True,user_id='2bccc45c05cb4e2090eacaaaeb99fdad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:58:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c14a94-ffcd-453f-a9f7-860c7fee78fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:58:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c14a94-ffcd-453f-a9f7-860c7fee78fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:58:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e01639-6979-45b9-85a9-660864ac9afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:58:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3e01639-6979-45b9-85a9-660864ac9afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0336043b-b8e1-44e6-b3d1-decff101b57e', 'volume_name': 'volume-0336043b-b8e1-44e6-b3d1-decff101b57e', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:58:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd485f1d-25d7-48dd-addd-ac40d8d30652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:58:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd485f1d-25d7-48dd-addd-ac40d8d30652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:58:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8308f22-c233-4d05-b478-9c2e4b0539e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:58:48 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Volume 0336043b-b8e1-44e6-b3d1-decff101b57e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0336043b-b8e1-44e6-b3d1-decff101b57e', 'volume_size': 1} Jul 08 00:58:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:58:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:58:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T22:58:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1536292057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0336043b-b8e1-44e6-b3d1-decff101b57e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='711c3a98b6da4246b195ff8b1f1ef6b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T22:58:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T22:58:48Z,use_quota=True,user_id='2bccc45c05cb4e2090eacaaaeb99fdad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 00:58:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Creating volume 0336043b-b8e1-44e6-b3d1-decff101b57e {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 00:58:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:58:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:58:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 00:58:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 00:58:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:58:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 00:58:48 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 00:58:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0336043b-b8e1-44e6-b3d1-decff101b57e 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:48 devstack sudo[88390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0336043b-b8e1-44e6-b3d1-decff101b57e 1073741824 Jul 08 00:58:48 devstack sudo[88390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:50 devstack sudo[88390]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0336043b-b8e1-44e6-b3d1-decff101b57e 1073741824" returned: 0 in 2.084s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0336043b-b8e1-44e6-b3d1-decff101b57e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:50 devstack sudo[88398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0336043b-b8e1-44e6-b3d1-decff101b57e Jul 08 00:58:50 devstack sudo[88398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:51 devstack sudo[88398]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0336043b-b8e1-44e6-b3d1-decff101b57e" returned: 0 in 1.722s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:58:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] <== create_volume: return (3903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 00:58:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.914s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:58:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8308f22-c233-4d05-b478-9c2e4b0539e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0336043b-b8e1-44e6-b3d1-decff101b57e', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:58:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3642fd-552e-434d-9604-132d68a2aeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:58:52 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Volume volume-0336043b-b8e1-44e6-b3d1-decff101b57e (0336043b-b8e1-44e6-b3d1-decff101b57e): created successfully Jul 08 00:58:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c3642fd-552e-434d-9604-132d68a2aeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:58:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Flow 'volume_create_manager' (c8916025-225c-44c1-af2b-48d9c8d2ea85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 00:58:52 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-d0065efc-f101-4f8d-94e7-18a748d914c9 tempest-VolumesAdminNegativeTest-231095021 None] Created volume successfully. Jul 08 00:58:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] Acquiring lock "cinder-0336043b-b8e1-44e6-b3d1-decff101b57e-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 00:58:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] Lock "cinder-0336043b-b8e1-44e6-b3d1-decff101b57e-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 00:58:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] Acquiring lock "cinder-quobyte-0336043b-b8e1-44e6-b3d1-decff101b57e" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 00:58:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] Lock "cinder-quobyte-0336043b-b8e1-44e6-b3d1-decff101b57e" acquired by "delete_volume" :: waited 0.040s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 00:58:54 devstack cinder-volume[87123]: INFO oslo.privsep.daemon [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpguw447c1/privsep.sock'] Jul 08 00:58:54 devstack sudo[88409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpguw447c1/privsep.sock Jul 08 00:58:54 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:55 devstack cinder-volume[87123]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 08 00:58:55 devstack cinder-volume[87123]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 00:58:55 devstack cinder-volume[87123]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 00:58:55 devstack cinder-volume[87123]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 00:58:55 devstack cinder-volume[87123]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 00:58:55 devstack cinder-volume[87123]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 00:58:55 devstack cinder-volume[87123]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 00:58:55 devstack cinder-volume[87123]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 00:58:55 devstack cinder-volume[87123]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 08 00:58:57 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 00:58:57 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Flow 'volume_create_manager' (c567986f-6e75-4e36-8943-09132f1ef3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 00:58:57 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (063b66a7-d761-4b05-a8e5-5025de53c115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:58:57 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (063b66a7-d761-4b05-a8e5-5025de53c115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T22:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-327035055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=950a9b2d-713a-43be-832a-6557334d32b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a094f80841474c9b93e4b424e8098af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T22:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T22:58:57Z,use_quota=True,user_id='f94ba85d2b2f4b1092d70fe705dc8c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:58:57 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74491a48-dab0-49f2-839d-7b886180851f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:58:57 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74491a48-dab0-49f2-839d-7b886180851f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:58:57 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83ece88-2101-4ea6-b944-2ef9555d1106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:58:57 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b83ece88-2101-4ea6-b944-2ef9555d1106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '950a9b2d-713a-43be-832a-6557334d32b3', 'volume_name': 'volume-950a9b2d-713a-43be-832a-6557334d32b3', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:58:57 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39402ad7-f98e-4f35-a514-859d8ef068fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:58:57 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39402ad7-f98e-4f35-a514-859d8ef068fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:58:57 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e149e742-ed49-439e-953c-db6a2a7453b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:58:57 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Volume 950a9b2d-713a-43be-832a-6557334d32b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-950a9b2d-713a-43be-832a-6557334d32b3', 'volume_size': 1} Jul 08 00:58:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:58:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:58:57 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T22:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-327035055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=950a9b2d-713a-43be-832a-6557334d32b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a094f80841474c9b93e4b424e8098af6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T22:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T22:58:57Z,use_quota=True,user_id='f94ba85d2b2f4b1092d70fe705dc8c46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 00:58:57 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Creating volume 950a9b2d-713a-43be-832a-6557334d32b3 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 00:58:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:58:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:58:57 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 00:58:57 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 00:58:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:58:57 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 00:58:57 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 00:58:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-950a9b2d-713a-43be-832a-6557334d32b3 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:57 devstack sudo[88444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-950a9b2d-713a-43be-832a-6557334d32b3 1073741824 Jul 08 00:58:57 devstack sudo[88444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:58:58 devstack cinder-volume[87123]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 08 00:58:58 devstack cinder-volume[87123]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 08 00:58:58 devstack cinder-volume[87123]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 08 00:58:58 devstack cinder-volume[87123]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 00:58:58 devstack cinder-volume[87123]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 08 00:58:58 devstack cinder-volume[87123]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 08 00:58:58 devstack cinder-volume[87123]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 08 00:58:58 devstack cinder-volume[87123]: WARNING oslo.privsep.daemon [-] privsep log: Jul 08 00:58:58 devstack cinder-volume[87123]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 08 00:58:59 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root Jul 08 00:58:59 devstack cinder-volume[87123]: INFO oslo.privsep.daemon [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] Spawned new privsep daemon via rootwrap Jul 08 00:58:59 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] Accepted privsep connection to /tmp/tmpguw447c1/privsep.sock {{(pid=87123) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 08 00:58:59 devstack cinder-volume[87123]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 08 00:58:59 devstack cinder-volume[87123]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 08 00:58:59 devstack cinder-volume[87123]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 08 00:58:59 devstack cinder-volume[87123]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88450 Jul 08 00:58:59 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[53111578-021a-4cbe-8f3e-a430a300b6c5]: (2,) {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 00:58:59 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bd985d-4b56-4c57-b7b4-02586015e7cb]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 00:58:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0336043b-b8e1-44e6-b3d1-decff101b57e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:58:59 devstack sudo[88456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0336043b-b8e1-44e6-b3d1-decff101b57e Jul 08 00:58:59 devstack sudo[88456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:59:00 devstack sudo[88444]: pam_unix(sudo:session): session closed for user root Jul 08 00:59:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-950a9b2d-713a-43be-832a-6557334d32b3 1073741824" returned: 0 in 2.515s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:59:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-950a9b2d-713a-43be-832a-6557334d32b3 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:59:00 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-950a9b2d-713a-43be-832a-6557334d32b3 Jul 08 00:59:00 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:59:02 devstack sudo[88456]: pam_unix(sudo:session): session closed for user root Jul 08 00:59:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0336043b-b8e1-44e6-b3d1-decff101b57e" returned: 0 in 2.340s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:59:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0336043b-b8e1-44e6-b3d1-decff101b57e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:59:02 devstack sudo[88498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0336043b-b8e1-44e6-b3d1-decff101b57e Jul 08 00:59:02 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:59:02 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Jul 08 00:59:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-950a9b2d-713a-43be-832a-6557334d32b3" returned: 0 in 1.914s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:59:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] <== create_volume: return (4574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 00:59:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.583s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:59:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e149e742-ed49-439e-953c-db6a2a7453b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-950a9b2d-713a-43be-832a-6557334d32b3', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:59:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c7ced48-acb6-46dd-8570-83f77a974970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:59:02 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Volume volume-950a9b2d-713a-43be-832a-6557334d32b3 (950a9b2d-713a-43be-832a-6557334d32b3): created successfully Jul 08 00:59:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c7ced48-acb6-46dd-8570-83f77a974970) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:59:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Flow 'volume_create_manager' (c567986f-6e75-4e36-8943-09132f1ef3b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 00:59:02 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-a32b9352-9163-4f36-8b32-7aa6f6c9351c tempest-ServerRescueNegativeTestJSON-149204801 None] Created volume successfully. Jul 08 00:59:03 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root Jul 08 00:59:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0336043b-b8e1-44e6-b3d1-decff101b57e" returned: 0 in 1.517s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:59:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] Lock "cinder-quobyte-0336043b-b8e1-44e6-b3d1-decff101b57e" released by "delete_volume" :: held 9.650s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 00:59:03 devstack cinder-volume[87123]: WARNING cinder.quota [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 00:59:03 devstack cinder-volume[87123]: WARNING cinder.quota [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 00:59:03 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] Created reservations ['fbfb84e2-1e92-48b6-b7d9-ba74fdb5bc3e', '9688ceb1-1261-4f86-b0a8-4ec63eddd2d1', '0c655ca5-83fe-4dbd-971a-a59063d2e988', '3585d8a1-ea6d-4567-b3b7-c9c08c7c3e1a'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 00:59:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:59:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:59:04 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 00:59:04 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 00:59:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:59:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:59:04 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 00:59:04 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:59:06 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Jul 08 00:59:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 2.269s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:59:06 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 00:59:06 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] Deleted volume successfully. Jul 08 00:59:06 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-91b60a8c-bf4c-4b81-b3b7-4d91c023b9f7 tempest-VolumesAdminNegativeTest-231095021 None] Lock "cinder-0336043b-b8e1-44e6-b3d1-decff101b57e-delete_volume" released by "delete_volume" :: held 12.743s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 00:59:14 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=10,cinder:UPDATE=17,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 00:59:16 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=9,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 00:59:34 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-26a34509-ce60-43c9-b441-20605e39b643 tempest-ServerRescueNegativeTestJSON-149204801 None] Acquiring lock "cinder-950a9b2d-713a-43be-832a-6557334d32b3-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 00:59:34 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-26a34509-ce60-43c9-b441-20605e39b643 tempest-ServerRescueNegativeTestJSON-149204801 None] Lock "cinder-950a9b2d-713a-43be-832a-6557334d32b3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 00:59:34 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-26a34509-ce60-43c9-b441-20605e39b643 tempest-ServerRescueNegativeTestJSON-149204801 None] Acquiring lock "cinder-quobyte-950a9b2d-713a-43be-832a-6557334d32b3" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 00:59:34 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-26a34509-ce60-43c9-b441-20605e39b643 tempest-ServerRescueNegativeTestJSON-149204801 None] Lock "cinder-quobyte-950a9b2d-713a-43be-832a-6557334d32b3" acquired by "delete_volume" :: waited 0.046s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 00:59:34 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[17bb01dd-8b27-44f6-a0ee-7b866a9ed7b4]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 00:59:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-26a34509-ce60-43c9-b441-20605e39b643 tempest-ServerRescueNegativeTestJSON-149204801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-950a9b2d-713a-43be-832a-6557334d32b3 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:59:34 devstack sudo[88785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-950a9b2d-713a-43be-832a-6557334d32b3 Jul 08 00:59:34 devstack sudo[88785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:59:35 devstack sudo[88785]: pam_unix(sudo:session): session closed for user root Jul 08 00:59:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-26a34509-ce60-43c9-b441-20605e39b643 tempest-ServerRescueNegativeTestJSON-149204801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-950a9b2d-713a-43be-832a-6557334d32b3" returned: 0 in 1.417s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:59:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-26a34509-ce60-43c9-b441-20605e39b643 tempest-ServerRescueNegativeTestJSON-149204801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-950a9b2d-713a-43be-832a-6557334d32b3 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:59:35 devstack sudo[88790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-950a9b2d-713a-43be-832a-6557334d32b3 Jul 08 00:59:35 devstack sudo[88790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:59:37 devstack sudo[88790]: pam_unix(sudo:session): session closed for user root Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-26a34509-ce60-43c9-b441-20605e39b643 tempest-ServerRescueNegativeTestJSON-149204801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-950a9b2d-713a-43be-832a-6557334d32b3" returned: 0 in 1.344s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-26a34509-ce60-43c9-b441-20605e39b643 tempest-ServerRescueNegativeTestJSON-149204801 None] Lock "cinder-quobyte-950a9b2d-713a-43be-832a-6557334d32b3" released by "delete_volume" :: held 2.883s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-26a34509-ce60-43c9-b441-20605e39b643 tempest-ServerRescueNegativeTestJSON-149204801 None] Created reservations ['74e0f7d4-8b7f-4dfe-9013-dcab88c750bc', 'd484123d-5c99-4068-b9c6-a1b5461ed6eb', '21e37b76-a368-4541-add3-7476c81664b1', 'a66d2dbe-f749-493a-845c-c9949d8112c1'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Flow 'volume_create_manager' (8beff438-d6ab-4a84-b715-b875acbff496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8390d571-1aad-4bc3-8fd2-1c1680eecf18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8390d571-1aad-4bc3-8fd2-1c1680eecf18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T22:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2048709025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d16fc90-7765-4a29-b4f6-59a46f7be597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec1bcc68ccd4883affbd65ee24563f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T22:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T22:59:37Z,use_quota=True,user_id='62d7cbc1a0244cb6be72617a2cf514e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50727672-262b-4ded-b2d5-21615dbdc646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50727672-262b-4ded-b2d5-21615dbdc646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f9442e4-321d-489f-a6a3-a682651f1515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f9442e4-321d-489f-a6a3-a682651f1515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d16fc90-7765-4a29-b4f6-59a46f7be597', 'volume_name': 'volume-7d16fc90-7765-4a29-b4f6-59a46f7be597', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e2cfc01-2fbb-4791-82fb-2b816f050f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e2cfc01-2fbb-4791-82fb-2b816f050f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af02f56-4b76-4a78-a698-41c638ab4877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:59:37 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Volume 7d16fc90-7765-4a29-b4f6-59a46f7be597: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d16fc90-7765-4a29-b4f6-59a46f7be597', 'volume_size': 1} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T22:59:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-2048709025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d16fc90-7765-4a29-b4f6-59a46f7be597,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fec1bcc68ccd4883affbd65ee24563f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T22:59:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T22:59:37Z,use_quota=True,user_id='62d7cbc1a0244cb6be72617a2cf514e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Creating volume 7d16fc90-7765-4a29-b4f6-59a46f7be597 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 00:59:37 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7d16fc90-7765-4a29-b4f6-59a46f7be597 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:59:37 devstack sudo[88797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7d16fc90-7765-4a29-b4f6-59a46f7be597 1073741824 Jul 08 00:59:37 devstack sudo[88797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-26a34509-ce60-43c9-b441-20605e39b643 tempest-ServerRescueNegativeTestJSON-149204801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-26a34509-ce60-43c9-b441-20605e39b643 tempest-ServerRescueNegativeTestJSON-149204801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-26a34509-ce60-43c9-b441-20605e39b643 tempest-ServerRescueNegativeTestJSON-149204801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-26a34509-ce60-43c9-b441-20605e39b643 tempest-ServerRescueNegativeTestJSON-149204801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-26a34509-ce60-43c9-b441-20605e39b643 tempest-ServerRescueNegativeTestJSON-149204801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:59:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-26a34509-ce60-43c9-b441-20605e39b643 tempest-ServerRescueNegativeTestJSON-149204801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:59:37 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 00:59:37 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:59:39 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Jul 08 00:59:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-26a34509-ce60-43c9-b441-20605e39b643 tempest-ServerRescueNegativeTestJSON-149204801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.800s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:59:39 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-26a34509-ce60-43c9-b441-20605e39b643 tempest-ServerRescueNegativeTestJSON-149204801 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 00:59:39 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-26a34509-ce60-43c9-b441-20605e39b643 tempest-ServerRescueNegativeTestJSON-149204801 None] Deleted volume successfully. Jul 08 00:59:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-26a34509-ce60-43c9-b441-20605e39b643 tempest-ServerRescueNegativeTestJSON-149204801 None] Lock "cinder-950a9b2d-713a-43be-832a-6557334d32b3-delete_volume" released by "delete_volume" :: held 5.602s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 00:59:39 devstack sudo[88797]: pam_unix(sudo:session): session closed for user root Jul 08 00:59:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7d16fc90-7765-4a29-b4f6-59a46f7be597 1073741824" returned: 0 in 2.281s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:59:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7d16fc90-7765-4a29-b4f6-59a46f7be597 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:59:40 devstack sudo[88816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7d16fc90-7765-4a29-b4f6-59a46f7be597 Jul 08 00:59:40 devstack sudo[88816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:59:42 devstack sudo[88816]: pam_unix(sudo:session): session closed for user root Jul 08 00:59:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7d16fc90-7765-4a29-b4f6-59a46f7be597" returned: 0 in 1.992s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:59:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] <== create_volume: return (4383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 00:59:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.391s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:59:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7af02f56-4b76-4a78-a698-41c638ab4877) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d16fc90-7765-4a29-b4f6-59a46f7be597', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:59:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb26c6a-eccd-44be-9f9e-889460227207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:59:42 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Volume volume-7d16fc90-7765-4a29-b4f6-59a46f7be597 (7d16fc90-7765-4a29-b4f6-59a46f7be597): created successfully Jul 08 00:59:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb26c6a-eccd-44be-9f9e-889460227207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:59:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Flow 'volume_create_manager' (8beff438-d6ab-4a84-b715-b875acbff496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 00:59:42 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-19e41063-f439-4c98-ba2c-ac09f1a9d887 tempest-DeleteServersTestJSON-1503077799 None] Created volume successfully. Jul 08 00:59:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 00:59:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:59:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:59:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 00:59:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 00:59:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:59:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:59:45 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 00:59:45 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:59:46 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Jul 08 00:59:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.388s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:59:46 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 00:59:46 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 00:59:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 8 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 00:59:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 00:59:50 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-641d6cd0-78b8-4d07-902f-6c503c81aaad tempest-GroupsTest-1870653936 None] Group tempest-Group1-1068415235: creating Jul 08 00:59:50 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-641d6cd0-78b8-4d07-902f-6c503c81aaad tempest-GroupsTest-1870653936 None] Group tempest-Group1-1068415235: created successfully Jul 08 00:59:50 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-641d6cd0-78b8-4d07-902f-6c503c81aaad tempest-GroupsTest-1870653936 None] Create group completed successfully. Jul 08 00:59:51 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-1eaac007-46c5-4ddb-bcd3-b2fb35562c03 tempest-GroupsTest-1870653936 None] Group tempest-Group2-998257835: creating Jul 08 00:59:51 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-1eaac007-46c5-4ddb-bcd3-b2fb35562c03 tempest-GroupsTest-1870653936 None] Group tempest-Group2-998257835: created successfully Jul 08 00:59:51 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-1eaac007-46c5-4ddb-bcd3-b2fb35562c03 tempest-GroupsTest-1870653936 None] Create group completed successfully. Jul 08 00:59:51 devstack cinder-volume[87123]: WARNING py.warnings [req-7cc36527-18f4-4951-a289-7091c488b4e1 req-074fd244-dd53-4a6e-aa5d-bafc55865681 tempest-DeleteServersTestJSON-1503077799 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 08 00:59:51 devstack cinder-volume[87123]: .first() Jul 08 00:59:51 devstack cinder-volume[87123]: Jul 08 00:59:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-7cc36527-18f4-4951-a289-7091c488b4e1 req-074fd244-dd53-4a6e-aa5d-bafc55865681 tempest-DeleteServersTestJSON-1503077799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:59:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-7cc36527-18f4-4951-a289-7091c488b4e1 req-074fd244-dd53-4a6e-aa5d-bafc55865681 tempest-DeleteServersTestJSON-1503077799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:59:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-e8d83d1f-5bef-4190-8d41-55a427c665d0 req-46cfa1ad-69d8-430d-ab17-ec46f8ebcc15 tempest-TaggedAttachmentsTest-1584690808 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:59:51 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87f7ee1-1ae2-4902-a5ca-a663c55da656]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 00:59:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-7cc36527-18f4-4951-a289-7091c488b4e1 req-074fd244-dd53-4a6e-aa5d-bafc55865681 tempest-DeleteServersTestJSON-1503077799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7d16fc90-7765-4a29-b4f6-59a46f7be597 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:59:52 devstack sudo[88998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7d16fc90-7765-4a29-b4f6-59a46f7be597 Jul 08 00:59:52 devstack sudo[88998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:59:52 devstack sudo[88998]: pam_unix(sudo:session): session closed for user root Jul 08 00:59:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-7cc36527-18f4-4951-a289-7091c488b4e1 req-074fd244-dd53-4a6e-aa5d-bafc55865681 tempest-DeleteServersTestJSON-1503077799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7d16fc90-7765-4a29-b4f6-59a46f7be597" returned: 0 in 0.957s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:59:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-7cc36527-18f4-4951-a289-7091c488b4e1 req-074fd244-dd53-4a6e-aa5d-bafc55865681 tempest-DeleteServersTestJSON-1503077799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.984s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:59:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-e8d83d1f-5bef-4190-8d41-55a427c665d0 req-46cfa1ad-69d8-430d-ab17-ec46f8ebcc15 tempest-TaggedAttachmentsTest-1584690808 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.979s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:59:52 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96b0d1b-5747-476b-9a8d-86a39a54b284]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 00:59:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-e8d83d1f-5bef-4190-8d41-55a427c665d0 req-46cfa1ad-69d8-430d-ab17-ec46f8ebcc15 tempest-TaggedAttachmentsTest-1584690808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-79899ecd-af34-4d25-b891-1a3078581c90 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:59:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-7cc36527-18f4-4951-a289-7091c488b4e1 req-074fd244-dd53-4a6e-aa5d-bafc55865681 tempest-DeleteServersTestJSON-1503077799 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e', 'name': 'volume-7d16fc90-7765-4a29-b4f6-59a46f7be597', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb048dfb-bae5-4e64-ac2b-62b48a0e55cb', 'enforce_multipath': True} {{(pid=87123) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 00:59:53 devstack sudo[89005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-79899ecd-af34-4d25-b891-1a3078581c90 Jul 08 00:59:53 devstack sudo[89005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:59:53 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-7cc36527-18f4-4951-a289-7091c488b4e1 req-074fd244-dd53-4a6e-aa5d-bafc55865681 tempest-DeleteServersTestJSON-1503077799 None] attachment_update completed successfully. Jul 08 00:59:53 devstack sudo[89005]: pam_unix(sudo:session): session closed for user root Jul 08 00:59:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-e8d83d1f-5bef-4190-8d41-55a427c665d0 req-46cfa1ad-69d8-430d-ab17-ec46f8ebcc15 tempest-TaggedAttachmentsTest-1584690808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-79899ecd-af34-4d25-b891-1a3078581c90" returned: 0 in 1.099s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:59:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-e8d83d1f-5bef-4190-8d41-55a427c665d0 req-46cfa1ad-69d8-430d-ab17-ec46f8ebcc15 tempest-TaggedAttachmentsTest-1584690808 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.132s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-e8d83d1f-5bef-4190-8d41-55a427c665d0 req-46cfa1ad-69d8-430d-ab17-ec46f8ebcc15 tempest-TaggedAttachmentsTest-1584690808 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e', 'name': 'volume-79899ecd-af34-4d25-b891-1a3078581c90', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e9590d54-cea1-49c6-8de3-1d75992a91e0', 'enforce_multipath': True} {{(pid=87123) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 00:59:54 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-e8d83d1f-5bef-4190-8d41-55a427c665d0 req-46cfa1ad-69d8-430d-ab17-ec46f8ebcc15 tempest-TaggedAttachmentsTest-1584690808 None] attachment_update completed successfully. Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Flow 'volume_create_manager' (f06dc337-74ab-4a6e-bbc7-df29d5e4160a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d5d006-912a-4fe3-b035-26449a26899b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7d5d006-912a-4fe3-b035-26449a26899b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T22:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-26132189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ddd10d30-a768-4f4e-95b5-c46df5d81ae8,host='devstack@QuobyteHD#QuobyteHD',id=a0d085c0-9391-4414-bc8e-e0ef2a175309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='071ba94fc2ad4283b2c0846dce27967e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T22:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T22:59:54Z,use_quota=True,user_id='8d3257b528054eb493f302e4133549dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a6596d-8e8a-4eb8-bcf6-9ab55051a893),volume_type_id=76a6596d-8e8a-4eb8-bcf6-9ab55051a893)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc27de5-9e60-4e95-b62d-50d90f21eae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ebc27de5-9e60-4e95-b62d-50d90f21eae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79cb6a2e-cad9-4c02-9665-c367f7c2099d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79cb6a2e-cad9-4c02-9665-c367f7c2099d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0d085c0-9391-4414-bc8e-e0ef2a175309', 'volume_name': 'volume-a0d085c0-9391-4414-bc8e-e0ef2a175309', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1808ec6c-4331-48e2-a068-205b8476a359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1808ec6c-4331-48e2-a068-205b8476a359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36734da1-cc7c-4c08-aef2-6a817f8c8fca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:59:54 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Volume a0d085c0-9391-4414-bc8e-e0ef2a175309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0d085c0-9391-4414-bc8e-e0ef2a175309', 'volume_size': 1} Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ddd10d30-a768-4f4e-95b5-c46df5d81ae8,created_at=2026-07-07T22:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-26132189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ddd10d30-a768-4f4e-95b5-c46df5d81ae8,host='devstack@QuobyteHD#QuobyteHD',id=a0d085c0-9391-4414-bc8e-e0ef2a175309,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='071ba94fc2ad4283b2c0846dce27967e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T22:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T22:59:54Z,use_quota=True,user_id='8d3257b528054eb493f302e4133549dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76a6596d-8e8a-4eb8-bcf6-9ab55051a893),volume_type_id=76a6596d-8e8a-4eb8-bcf6-9ab55051a893)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Creating volume a0d085c0-9391-4414-bc8e-e0ef2a175309 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 00:59:54 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 00:59:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a0d085c0-9391-4414-bc8e-e0ef2a175309 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:59:54 devstack sudo[89394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a0d085c0-9391-4414-bc8e-e0ef2a175309 1073741824 Jul 08 00:59:54 devstack sudo[89394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:59:55 devstack sudo[89394]: pam_unix(sudo:session): session closed for user root Jul 08 00:59:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a0d085c0-9391-4414-bc8e-e0ef2a175309 1073741824" returned: 0 in 1.389s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:59:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a0d085c0-9391-4414-bc8e-e0ef2a175309 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:59:56 devstack sudo[89409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a0d085c0-9391-4414-bc8e-e0ef2a175309 Jul 08 00:59:56 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 00:59:56 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root Jul 08 00:59:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a0d085c0-9391-4414-bc8e-e0ef2a175309" returned: 0 in 0.814s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 00:59:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] <== create_volume: return (2272ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 00:59:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.277s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 00:59:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36734da1-cc7c-4c08-aef2-6a817f8c8fca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0d085c0-9391-4414-bc8e-e0ef2a175309', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:59:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d7c7b8f-2eb9-446c-9a1a-008fcadf5bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 00:59:56 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Volume volume-a0d085c0-9391-4414-bc8e-e0ef2a175309 (a0d085c0-9391-4414-bc8e-e0ef2a175309): created successfully Jul 08 00:59:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d7c7b8f-2eb9-446c-9a1a-008fcadf5bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 00:59:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Flow 'volume_create_manager' (f06dc337-74ab-4a6e-bbc7-df29d5e4160a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 00:59:56 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-8747ca33-3a04-4598-8ba5-fd5c7e419e48 tempest-GroupsTest-1870653936 None] Created volume successfully. Jul 08 00:59:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5a305ea1-7da9-4bbb-a53a-1bf01053170e tempest-GroupsTest-1870653936 None] Acquiring lock "cinder-quobyte-a0d085c0-9391-4414-bc8e-e0ef2a175309" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 00:59:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5a305ea1-7da9-4bbb-a53a-1bf01053170e tempest-GroupsTest-1870653936 None] Lock "cinder-quobyte-a0d085c0-9391-4414-bc8e-e0ef2a175309" acquired by "delete_volume" :: waited 0.022s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 00:59:59 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e1941a-421f-4e3d-a188-c43d829c6226]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 00:59:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5a305ea1-7da9-4bbb-a53a-1bf01053170e tempest-GroupsTest-1870653936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a0d085c0-9391-4414-bc8e-e0ef2a175309 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 00:59:59 devstack sudo[89416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a0d085c0-9391-4414-bc8e-e0ef2a175309 Jul 08 00:59:59 devstack sudo[89416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:00 devstack sudo[89416]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5a305ea1-7da9-4bbb-a53a-1bf01053170e tempest-GroupsTest-1870653936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a0d085c0-9391-4414-bc8e-e0ef2a175309" returned: 0 in 1.580s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5a305ea1-7da9-4bbb-a53a-1bf01053170e tempest-GroupsTest-1870653936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a0d085c0-9391-4414-bc8e-e0ef2a175309 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:00 devstack sudo[89451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a0d085c0-9391-4414-bc8e-e0ef2a175309 Jul 08 01:00:00 devstack sudo[89451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:01 devstack sudo[89451]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5a305ea1-7da9-4bbb-a53a-1bf01053170e tempest-GroupsTest-1870653936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a0d085c0-9391-4414-bc8e-e0ef2a175309" returned: 0 in 0.901s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:01 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5a305ea1-7da9-4bbb-a53a-1bf01053170e tempest-GroupsTest-1870653936 None] Lock "cinder-quobyte-a0d085c0-9391-4414-bc8e-e0ef2a175309" released by "delete_volume" :: held 2.552s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:00:01 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-5a305ea1-7da9-4bbb-a53a-1bf01053170e tempest-GroupsTest-1870653936 None] Created reservations ['454eecd3-86c1-4fff-957a-099c35913827'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:00:01 devstack cinder-volume[87123]: WARNING cinder.quota [None req-5a305ea1-7da9-4bbb-a53a-1bf01053170e tempest-GroupsTest-1870653936 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1095463077 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1095463077, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:00:01 devstack cinder-volume[87123]: WARNING cinder.quota [None req-5a305ea1-7da9-4bbb-a53a-1bf01053170e tempest-GroupsTest-1870653936 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1095463077 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1095463077, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:00:02 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-5a305ea1-7da9-4bbb-a53a-1bf01053170e tempest-GroupsTest-1870653936 None] Created reservations ['7d94b88a-b2f2-4673-a79b-f14eab10eb20', '07609025-86c5-43b3-87ec-ace5399741f1', '428439e1-570f-4e6a-abb0-a8886dc1256b', '99dcec13-e145-44d7-93b3-769340b801fd'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:00:02 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-e6f62898-5368-4623-8e23-9f9ab9b01066 req-e056a1e5-cb55-4548-afe2-df494ae2ccb2 tempest-TaggedAttachmentsTest-1584690808 None] Terminate volume connection completed successfully. Jul 08 01:00:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-e6f62898-5368-4623-8e23-9f9ab9b01066 req-e056a1e5-cb55-4548-afe2-df494ae2ccb2 tempest-TaggedAttachmentsTest-1584690808 None] Deleting attachment e9590d54-cea1-49c6-8de3-1d75992a91e0. {{(pid=87123) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:00:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5a305ea1-7da9-4bbb-a53a-1bf01053170e tempest-GroupsTest-1870653936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:00:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5a305ea1-7da9-4bbb-a53a-1bf01053170e tempest-GroupsTest-1870653936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:00:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5a305ea1-7da9-4bbb-a53a-1bf01053170e tempest-GroupsTest-1870653936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:00:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5a305ea1-7da9-4bbb-a53a-1bf01053170e tempest-GroupsTest-1870653936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:00:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5a305ea1-7da9-4bbb-a53a-1bf01053170e tempest-GroupsTest-1870653936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:00:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5a305ea1-7da9-4bbb-a53a-1bf01053170e tempest-GroupsTest-1870653936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:02 devstack sudo[89484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:00:02 devstack sudo[89484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:02 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-d0f720b9-2598-4516-aac1-0b7bbdd6498c req-d5373b15-90b3-48d9-962e-a83959ae7cae tempest-DeleteServersTestJSON-1503077799 None] Terminate volume connection completed successfully. Jul 08 01:00:03 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-d0f720b9-2598-4516-aac1-0b7bbdd6498c req-d5373b15-90b3-48d9-962e-a83959ae7cae tempest-DeleteServersTestJSON-1503077799 None] Deleting attachment eb048dfb-bae5-4e64-ac2b-62b48a0e55cb. {{(pid=87123) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:00:03 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-fca5f893-3477-4d0e-a37e-4eb318121932 tempest-GroupsTest-1870653936 None] Created reservations ['68e6d9e1-5a75-46d1-9b75-c43f22d65e3b'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:00:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fca5f893-3477-4d0e-a37e-4eb318121932 tempest-GroupsTest-1870653936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:00:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fca5f893-3477-4d0e-a37e-4eb318121932 tempest-GroupsTest-1870653936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:00:03 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-fca5f893-3477-4d0e-a37e-4eb318121932 tempest-GroupsTest-1870653936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:00:03 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-fca5f893-3477-4d0e-a37e-4eb318121932 tempest-GroupsTest-1870653936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:00:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fca5f893-3477-4d0e-a37e-4eb318121932 tempest-GroupsTest-1870653936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:00:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fca5f893-3477-4d0e-a37e-4eb318121932 tempest-GroupsTest-1870653936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:03 devstack sudo[89484]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5a305ea1-7da9-4bbb-a53a-1bf01053170e tempest-GroupsTest-1870653936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.205s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:03 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-5a305ea1-7da9-4bbb-a53a-1bf01053170e tempest-GroupsTest-1870653936 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:00:03 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-5a305ea1-7da9-4bbb-a53a-1bf01053170e tempest-GroupsTest-1870653936 None] Delete group completed successfully. Jul 08 01:00:03 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:00:03 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:04 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fca5f893-3477-4d0e-a37e-4eb318121932 tempest-GroupsTest-1870653936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.042s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:04 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-fca5f893-3477-4d0e-a37e-4eb318121932 tempest-GroupsTest-1870653936 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:00:04 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-fca5f893-3477-4d0e-a37e-4eb318121932 tempest-GroupsTest-1870653936 None] Delete group completed successfully. Jul 08 01:00:05 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-126fde79-0e4f-4279-b254-e7c35c6ea59a tempest-GroupsTest-1870653936 None] Group tempest-GroupsTest-Group-2019966341: creating Jul 08 01:00:05 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-126fde79-0e4f-4279-b254-e7c35c6ea59a tempest-GroupsTest-1870653936 None] Group tempest-GroupsTest-Group-2019966341: created successfully Jul 08 01:00:05 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-126fde79-0e4f-4279-b254-e7c35c6ea59a tempest-GroupsTest-1870653936 None] Create group completed successfully. Jul 08 01:00:07 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:00:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Flow 'volume_create_manager' (bc0e46fc-3591-4609-a9fa-ffb33a85de12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:00:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea20615d-5567-4e9b-b29a-73037054a3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:00:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea20615d-5567-4e9b-b29a-73037054a3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1892731318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=38a2c332-f0e5-4e07-a8cc-f154337b902a,host='devstack@QuobyteHD#QuobyteHD',id=37af8dbe-d1d9-4833-be1d-2abd9f412cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='071ba94fc2ad4283b2c0846dce27967e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:00:07Z,use_quota=True,user_id='8d3257b528054eb493f302e4133549dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b74ce1aa-2bd4-4029-8296-d8dad01a8116),volume_type_id=b74ce1aa-2bd4-4029-8296-d8dad01a8116)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:00:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8c9edb-c68c-4221-9ac1-ed488807e6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:00:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8c9edb-c68c-4221-9ac1-ed488807e6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:00:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8dc141-9d87-4809-962c-86a683856bb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:00:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d8dc141-9d87-4809-962c-86a683856bb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37af8dbe-d1d9-4833-be1d-2abd9f412cc6', 'volume_name': 'volume-37af8dbe-d1d9-4833-be1d-2abd9f412cc6', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:00:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0003222f-ae45-4847-b19d-da6386ff59cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:00:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0003222f-ae45-4847-b19d-da6386ff59cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:00:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe44923-8264-4e41-90c4-fa39913d1698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:00:07 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Volume 37af8dbe-d1d9-4833-be1d-2abd9f412cc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37af8dbe-d1d9-4833-be1d-2abd9f412cc6', 'volume_size': 1} Jul 08 01:00:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:00:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:00:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=38a2c332-f0e5-4e07-a8cc-f154337b902a,created_at=2026-07-07T23:00:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1892731318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=38a2c332-f0e5-4e07-a8cc-f154337b902a,host='devstack@QuobyteHD#QuobyteHD',id=37af8dbe-d1d9-4833-be1d-2abd9f412cc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='071ba94fc2ad4283b2c0846dce27967e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:00:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:00:07Z,use_quota=True,user_id='8d3257b528054eb493f302e4133549dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b74ce1aa-2bd4-4029-8296-d8dad01a8116),volume_type_id=b74ce1aa-2bd4-4029-8296-d8dad01a8116)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:00:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Creating volume 37af8dbe-d1d9-4833-be1d-2abd9f412cc6 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:00:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:00:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:00:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:00:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:00:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:00:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:00:07 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:00:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-37af8dbe-d1d9-4833-be1d-2abd9f412cc6 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:07 devstack sudo[89557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-37af8dbe-d1d9-4833-be1d-2abd9f412cc6 1073741824 Jul 08 01:00:07 devstack sudo[89557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:08 devstack sudo[89557]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-37af8dbe-d1d9-4833-be1d-2abd9f412cc6 1073741824" returned: 0 in 1.063s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-37af8dbe-d1d9-4833-be1d-2abd9f412cc6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:08 devstack sudo[89567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-37af8dbe-d1d9-4833-be1d-2abd9f412cc6 Jul 08 01:00:08 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:08 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3b3472a4-ddac-4299-a53a-ac73a9edd9aa tempest-DeleteServersTestJSON-1503077799 None] Acquiring lock "cinder-7d16fc90-7765-4a29-b4f6-59a46f7be597-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:00:08 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3b3472a4-ddac-4299-a53a-ac73a9edd9aa tempest-DeleteServersTestJSON-1503077799 None] Lock "cinder-7d16fc90-7765-4a29-b4f6-59a46f7be597-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:00:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3b3472a4-ddac-4299-a53a-ac73a9edd9aa tempest-DeleteServersTestJSON-1503077799 None] Acquiring lock "cinder-quobyte-7d16fc90-7765-4a29-b4f6-59a46f7be597" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:00:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3b3472a4-ddac-4299-a53a-ac73a9edd9aa tempest-DeleteServersTestJSON-1503077799 None] Lock "cinder-quobyte-7d16fc90-7765-4a29-b4f6-59a46f7be597" acquired by "delete_volume" :: waited 0.030s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:00:09 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:09 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb445037-48a4-43a0-a624-4ce043a50cae]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:00:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3b3472a4-ddac-4299-a53a-ac73a9edd9aa tempest-DeleteServersTestJSON-1503077799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7d16fc90-7765-4a29-b4f6-59a46f7be597 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-37af8dbe-d1d9-4833-be1d-2abd9f412cc6" returned: 0 in 0.785s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] <== create_volume: return (1906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:00:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:00:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe44923-8264-4e41-90c4-fa39913d1698) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37af8dbe-d1d9-4833-be1d-2abd9f412cc6', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:00:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0867d656-bac7-41ce-ad94-baa920b120e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:00:09 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Volume volume-37af8dbe-d1d9-4833-be1d-2abd9f412cc6 (37af8dbe-d1d9-4833-be1d-2abd9f412cc6): created successfully Jul 08 01:00:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0867d656-bac7-41ce-ad94-baa920b120e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:00:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Flow 'volume_create_manager' (bc0e46fc-3591-4609-a9fa-ffb33a85de12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:00:09 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f849cb7a-9f43-42f6-b418-dfa9fcedab52 tempest-GroupsTest-1870653936 None] Created volume successfully. Jul 08 01:00:09 devstack sudo[89571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7d16fc90-7765-4a29-b4f6-59a46f7be597 Jul 08 01:00:09 devstack sudo[89571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:10 devstack sudo[89571]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3b3472a4-ddac-4299-a53a-ac73a9edd9aa tempest-DeleteServersTestJSON-1503077799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7d16fc90-7765-4a29-b4f6-59a46f7be597" returned: 0 in 0.971s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3b3472a4-ddac-4299-a53a-ac73a9edd9aa tempest-DeleteServersTestJSON-1503077799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7d16fc90-7765-4a29-b4f6-59a46f7be597 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:10 devstack sudo[89578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7d16fc90-7765-4a29-b4f6-59a46f7be597 Jul 08 01:00:10 devstack sudo[89578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Flow 'volume_create_manager' (33ec7613-bbb3-4305-beed-e4d9f854154e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (658cb762-37a7-4b57-a697-6b35654df2e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (658cb762-37a7-4b57-a697-6b35654df2e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-612800831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=38a2c332-f0e5-4e07-a8cc-f154337b902a,host='devstack@QuobyteHD#QuobyteHD',id=b806950a-51cb-477b-b1a4-bad2e6f9a9e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='071ba94fc2ad4283b2c0846dce27967e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:00:10Z,use_quota=True,user_id='8d3257b528054eb493f302e4133549dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b74ce1aa-2bd4-4029-8296-d8dad01a8116),volume_type_id=b74ce1aa-2bd4-4029-8296-d8dad01a8116)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52552db3-db80-4b8e-807a-ff9145e67f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52552db3-db80-4b8e-807a-ff9145e67f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be180a52-5a95-4fa7-baad-b3111b4cdc60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be180a52-5a95-4fa7-baad-b3111b4cdc60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b806950a-51cb-477b-b1a4-bad2e6f9a9e5', 'volume_name': 'volume-b806950a-51cb-477b-b1a4-bad2e6f9a9e5', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3672b733-4dda-4ddd-ac1e-320205b42489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3672b733-4dda-4ddd-ac1e-320205b42489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58958982-881f-4b66-bffc-1ebc3802e693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:00:10 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Volume b806950a-51cb-477b-b1a4-bad2e6f9a9e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b806950a-51cb-477b-b1a4-bad2e6f9a9e5', 'volume_size': 1} Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=38a2c332-f0e5-4e07-a8cc-f154337b902a,created_at=2026-07-07T23:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-612800831',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=38a2c332-f0e5-4e07-a8cc-f154337b902a,host='devstack@QuobyteHD#QuobyteHD',id=b806950a-51cb-477b-b1a4-bad2e6f9a9e5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='071ba94fc2ad4283b2c0846dce27967e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:00:10Z,use_quota=True,user_id='8d3257b528054eb493f302e4133549dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b74ce1aa-2bd4-4029-8296-d8dad01a8116),volume_type_id=b74ce1aa-2bd4-4029-8296-d8dad01a8116)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Creating volume b806950a-51cb-477b-b1a4-bad2e6f9a9e5 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:00:10 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b806950a-51cb-477b-b1a4-bad2e6f9a9e5 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:10 devstack sudo[89580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b806950a-51cb-477b-b1a4-bad2e6f9a9e5 1073741824 Jul 08 01:00:10 devstack sudo[89580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:10 devstack sudo[89578]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3b3472a4-ddac-4299-a53a-ac73a9edd9aa tempest-DeleteServersTestJSON-1503077799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7d16fc90-7765-4a29-b4f6-59a46f7be597" returned: 0 in 0.862s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3b3472a4-ddac-4299-a53a-ac73a9edd9aa tempest-DeleteServersTestJSON-1503077799 None] Lock "cinder-quobyte-7d16fc90-7765-4a29-b4f6-59a46f7be597" released by "delete_volume" :: held 1.889s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:00:11 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-3b3472a4-ddac-4299-a53a-ac73a9edd9aa tempest-DeleteServersTestJSON-1503077799 None] Created reservations ['9cd5a6bc-9031-4130-8944-68251919b238', 'd6e5c2db-6d52-408e-a5db-08361910e901', '06cf2bb7-1588-4619-8b81-a5cc050fe63e', 'a6495a09-6b75-4063-9018-ac356a7f3c27'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:00:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3b3472a4-ddac-4299-a53a-ac73a9edd9aa tempest-DeleteServersTestJSON-1503077799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:00:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3b3472a4-ddac-4299-a53a-ac73a9edd9aa tempest-DeleteServersTestJSON-1503077799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:00:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3b3472a4-ddac-4299-a53a-ac73a9edd9aa tempest-DeleteServersTestJSON-1503077799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:00:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3b3472a4-ddac-4299-a53a-ac73a9edd9aa tempest-DeleteServersTestJSON-1503077799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:00:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3b3472a4-ddac-4299-a53a-ac73a9edd9aa tempest-DeleteServersTestJSON-1503077799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:00:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3b3472a4-ddac-4299-a53a-ac73a9edd9aa tempest-DeleteServersTestJSON-1503077799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:11 devstack sudo[89586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:00:11 devstack sudo[89586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:11 devstack sudo[89580]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b806950a-51cb-477b-b1a4-bad2e6f9a9e5 1073741824" returned: 0 in 1.040s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b806950a-51cb-477b-b1a4-bad2e6f9a9e5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:11 devstack sudo[89589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b806950a-51cb-477b-b1a4-bad2e6f9a9e5 Jul 08 01:00:11 devstack sudo[89589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:11 devstack sudo[89586]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3b3472a4-ddac-4299-a53a-ac73a9edd9aa tempest-DeleteServersTestJSON-1503077799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.919s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:12 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-3b3472a4-ddac-4299-a53a-ac73a9edd9aa tempest-DeleteServersTestJSON-1503077799 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:00:12 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-3b3472a4-ddac-4299-a53a-ac73a9edd9aa tempest-DeleteServersTestJSON-1503077799 None] Deleted volume successfully. Jul 08 01:00:12 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3b3472a4-ddac-4299-a53a-ac73a9edd9aa tempest-DeleteServersTestJSON-1503077799 None] Lock "cinder-7d16fc90-7765-4a29-b4f6-59a46f7be597-delete_volume" released by "delete_volume" :: held 3.102s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:00:12 devstack sudo[89589]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b806950a-51cb-477b-b1a4-bad2e6f9a9e5" returned: 0 in 1.020s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] <== create_volume: return (2158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:00:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.160s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:00:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58958982-881f-4b66-bffc-1ebc3802e693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b806950a-51cb-477b-b1a4-bad2e6f9a9e5', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:00:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee565a3-16b0-41f7-9f87-dd0bfd6de845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:00:12 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Volume volume-b806950a-51cb-477b-b1a4-bad2e6f9a9e5 (b806950a-51cb-477b-b1a4-bad2e6f9a9e5): created successfully Jul 08 01:00:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ee565a3-16b0-41f7-9f87-dd0bfd6de845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:00:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Flow 'volume_create_manager' (33ec7613-bbb3-4305-beed-e4d9f854154e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:00:12 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b59e4325-614c-4bcc-9721-b1cd0607d3ea tempest-GroupsTest-1870653936 None] Created volume successfully. Jul 08 01:00:12 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-d3854d1a-7c50-4855-a131-c4d4363193fe tempest-GroupsTest-1870653936 None] Update group completed successfully. Jul 08 01:00:14 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-58b1af6c-6fac-48e2-8de4-2d0ddce9773e tempest-GroupsTest-1870653936 None] Update group completed successfully. Jul 08 01:00:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Acquiring lock "cinder-quobyte-37af8dbe-d1d9-4833-be1d-2abd9f412cc6" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:00:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Lock "cinder-quobyte-37af8dbe-d1d9-4833-be1d-2abd9f412cc6" acquired by "delete_volume" :: waited 0.024s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:00:16 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1aaff67-5dee-4eb1-9479-47ac2a53193a]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:00:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-37af8dbe-d1d9-4833-be1d-2abd9f412cc6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:16 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-37af8dbe-d1d9-4833-be1d-2abd9f412cc6 Jul 08 01:00:16 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:17 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-37af8dbe-d1d9-4833-be1d-2abd9f412cc6" returned: 0 in 1.080s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-37af8dbe-d1d9-4833-be1d-2abd9f412cc6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:17 devstack sudo[89626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-37af8dbe-d1d9-4833-be1d-2abd9f412cc6 Jul 08 01:00:17 devstack sudo[89626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:18 devstack sudo[89626]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-37af8dbe-d1d9-4833-be1d-2abd9f412cc6" returned: 0 in 0.992s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:18 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Lock "cinder-quobyte-37af8dbe-d1d9-4833-be1d-2abd9f412cc6" released by "delete_volume" :: held 2.148s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:00:18 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Acquiring lock "cinder-quobyte-b806950a-51cb-477b-b1a4-bad2e6f9a9e5" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:00:18 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Lock "cinder-quobyte-b806950a-51cb-477b-b1a4-bad2e6f9a9e5" acquired by "delete_volume" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:00:18 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb80417d-36a4-4dae-9977-22937ff16fd7]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:00:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b806950a-51cb-477b-b1a4-bad2e6f9a9e5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:18 devstack sudo[89631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b806950a-51cb-477b-b1a4-bad2e6f9a9e5 Jul 08 01:00:18 devstack sudo[89631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:19 devstack sudo[89631]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b806950a-51cb-477b-b1a4-bad2e6f9a9e5" returned: 0 in 1.054s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b806950a-51cb-477b-b1a4-bad2e6f9a9e5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:19 devstack sudo[89649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b806950a-51cb-477b-b1a4-bad2e6f9a9e5 Jul 08 01:00:19 devstack sudo[89649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:20 devstack sudo[89649]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b806950a-51cb-477b-b1a4-bad2e6f9a9e5" returned: 0 in 0.896s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Lock "cinder-quobyte-b806950a-51cb-477b-b1a4-bad2e6f9a9e5" released by "delete_volume" :: held 2.021s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:00:20 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Created reservations ['1d254eb6-0b64-4dd0-b1f6-4c8e7c8d0da4'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:00:20 devstack cinder-volume[87123]: WARNING cinder.quota [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-282181709 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-282181709, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:00:20 devstack cinder-volume[87123]: WARNING cinder.quota [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-282181709 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-282181709, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:00:20 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Created reservations ['8f309848-87c3-40f4-9590-2ee25f5f5d8a', '80dff4a7-0e88-452b-9bc1-2bc9d0e26c75', '38ebdf5e-ba8a-4801-b38f-40e4d2d1f33d', '002affd5-2d4b-4783-8104-c9d5fbb85c24'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:00:20 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Created reservations ['529aa208-ebf7-48dd-8107-67edc5ad4244', 'cb306edb-5e29-43ac-b54a-5f0227d98b8a', '8fc38b2a-44d3-46a8-ba69-503bce5d0e48', '5bdc9b45-fd10-420b-a7a7-1a54ab2c8156'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:00:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:00:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:00:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:00:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:00:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:00:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:21 devstack sudo[89654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:00:21 devstack sudo[89654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:21 devstack sudo[89654]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.825s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:21 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:00:21 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-71fee716-4a17-4c7a-93d7-7ca67a9bb39a tempest-GroupsTest-1870653936 None] Delete group completed successfully. Jul 08 01:00:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-58d396b8-a2bc-4aca-9113-d426e91094da tempest-TaggedAttachmentsTest-1584690808 None] Acquiring lock "cinder-79899ecd-af34-4d25-b891-1a3078581c90-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:00:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-58d396b8-a2bc-4aca-9113-d426e91094da tempest-TaggedAttachmentsTest-1584690808 None] Lock "cinder-79899ecd-af34-4d25-b891-1a3078581c90-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:00:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-58d396b8-a2bc-4aca-9113-d426e91094da tempest-TaggedAttachmentsTest-1584690808 None] Acquiring lock "cinder-quobyte-79899ecd-af34-4d25-b891-1a3078581c90" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:00:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-58d396b8-a2bc-4aca-9113-d426e91094da tempest-TaggedAttachmentsTest-1584690808 None] Lock "cinder-quobyte-79899ecd-af34-4d25-b891-1a3078581c90" acquired by "delete_volume" :: waited 0.024s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:00:24 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[725c30eb-dff4-44a9-9280-c2b5ad221c77]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:00:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-58d396b8-a2bc-4aca-9113-d426e91094da tempest-TaggedAttachmentsTest-1584690808 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-79899ecd-af34-4d25-b891-1a3078581c90 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:25 devstack sudo[89660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-79899ecd-af34-4d25-b891-1a3078581c90 Jul 08 01:00:25 devstack sudo[89660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:26 devstack sudo[89660]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-58d396b8-a2bc-4aca-9113-d426e91094da tempest-TaggedAttachmentsTest-1584690808 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-79899ecd-af34-4d25-b891-1a3078581c90" returned: 0 in 1.078s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-58d396b8-a2bc-4aca-9113-d426e91094da tempest-TaggedAttachmentsTest-1584690808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-79899ecd-af34-4d25-b891-1a3078581c90 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:26 devstack sudo[89665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-79899ecd-af34-4d25-b891-1a3078581c90 Jul 08 01:00:26 devstack sudo[89665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:26 devstack sudo[89665]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-58d396b8-a2bc-4aca-9113-d426e91094da tempest-TaggedAttachmentsTest-1584690808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-79899ecd-af34-4d25-b891-1a3078581c90" returned: 0 in 0.864s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-58d396b8-a2bc-4aca-9113-d426e91094da tempest-TaggedAttachmentsTest-1584690808 None] Lock "cinder-quobyte-79899ecd-af34-4d25-b891-1a3078581c90" released by "delete_volume" :: held 2.013s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:00:26 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=64,cinder:INSERT=13,cinder:UPDATE=72,cinder:DELETE=4 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:00:27 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-58d396b8-a2bc-4aca-9113-d426e91094da tempest-TaggedAttachmentsTest-1584690808 None] Created reservations ['a5c2659f-8af3-4d2a-b598-c5dd6d5bf9dd', 'dd4650bf-35f0-4295-8e82-10747e526564', '3a11d014-214c-4e44-b3c2-134b85fc7e48', '8383ee23-ebdd-4ea0-8ff6-cdd027534ae4'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:00:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-58d396b8-a2bc-4aca-9113-d426e91094da tempest-TaggedAttachmentsTest-1584690808 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:00:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-58d396b8-a2bc-4aca-9113-d426e91094da tempest-TaggedAttachmentsTest-1584690808 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:00:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-58d396b8-a2bc-4aca-9113-d426e91094da tempest-TaggedAttachmentsTest-1584690808 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:00:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-58d396b8-a2bc-4aca-9113-d426e91094da tempest-TaggedAttachmentsTest-1584690808 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:00:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-58d396b8-a2bc-4aca-9113-d426e91094da tempest-TaggedAttachmentsTest-1584690808 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:00:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-58d396b8-a2bc-4aca-9113-d426e91094da tempest-TaggedAttachmentsTest-1584690808 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:27 devstack sudo[89683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:00:27 devstack sudo[89683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:27 devstack sudo[89683]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-58d396b8-a2bc-4aca-9113-d426e91094da tempest-TaggedAttachmentsTest-1584690808 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.843s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:27 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-58d396b8-a2bc-4aca-9113-d426e91094da tempest-TaggedAttachmentsTest-1584690808 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:00:27 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-58d396b8-a2bc-4aca-9113-d426e91094da tempest-TaggedAttachmentsTest-1584690808 None] Deleted volume successfully. Jul 08 01:00:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-58d396b8-a2bc-4aca-9113-d426e91094da tempest-TaggedAttachmentsTest-1584690808 None] Lock "cinder-79899ecd-af34-4d25-b891-1a3078581c90-delete_volume" released by "delete_volume" :: held 3.209s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:00:37 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:INSERT=3,cinder:UPDATE=9 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:00:38 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:UPDATE=70,cinder:SELECT=78,cinder:INSERT=15,cinder:DELETE=3 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:00:43 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:00:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Flow 'volume_create_manager' (eec5d09b-d440-4581-8d9e-f40143b3a75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:00:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (726d24f8-ea9e-4b05-9e6c-120ae52d6b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:00:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (726d24f8-ea9e-4b05-9e6c-120ae52d6b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-366262180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052ae45f-8c0c-487c-9714-5fde9947997c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700211e602304b3198cc4c0142b242d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:00:43Z,use_quota=True,user_id='966591bf030a4aab950d57ab0f6e79ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:00:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877f3726-8324-4301-b05b-65f83ef55e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:00:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (877f3726-8324-4301-b05b-65f83ef55e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:00:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bcfe12a-5fee-423f-83ef-da0a407bf1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:00:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bcfe12a-5fee-423f-83ef-da0a407bf1c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '052ae45f-8c0c-487c-9714-5fde9947997c', 'volume_name': 'volume-052ae45f-8c0c-487c-9714-5fde9947997c', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:00:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6330c5f4-d151-4ac1-b1aa-a7de82ec617c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:00:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6330c5f4-d151-4ac1-b1aa-a7de82ec617c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:00:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06bb2570-f526-4ee8-94bc-91cc150009ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:00:43 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Volume 052ae45f-8c0c-487c-9714-5fde9947997c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-052ae45f-8c0c-487c-9714-5fde9947997c', 'volume_size': 1} Jul 08 01:00:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:00:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:00:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:00:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-366262180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=052ae45f-8c0c-487c-9714-5fde9947997c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='700211e602304b3198cc4c0142b242d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:00:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:00:43Z,use_quota=True,user_id='966591bf030a4aab950d57ab0f6e79ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:00:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Creating volume 052ae45f-8c0c-487c-9714-5fde9947997c {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:00:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:00:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:00:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:00:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:00:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:00:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:00:43 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:00:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-052ae45f-8c0c-487c-9714-5fde9947997c 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:43 devstack sudo[89769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-052ae45f-8c0c-487c-9714-5fde9947997c 1073741824 Jul 08 01:00:43 devstack sudo[89769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:00:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:00:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:00:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:00:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:00:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:00:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:44 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:00:44 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:45 devstack sudo[89769]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-052ae45f-8c0c-487c-9714-5fde9947997c 1073741824" returned: 0 in 1.843s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-052ae45f-8c0c-487c-9714-5fde9947997c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:45 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-052ae45f-8c0c-487c-9714-5fde9947997c Jul 08 01:00:45 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:46 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.546s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:46 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:00:47 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-052ae45f-8c0c-487c-9714-5fde9947997c" returned: 0 in 1.314s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] <== create_volume: return (3270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:00:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.283s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:00:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06bb2570-f526-4ee8-94bc-91cc150009ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-052ae45f-8c0c-487c-9714-5fde9947997c', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:00:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2891186-ed17-46de-a29a-ea4803c9c62e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:00:47 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Volume volume-052ae45f-8c0c-487c-9714-5fde9947997c (052ae45f-8c0c-487c-9714-5fde9947997c): created successfully Jul 08 01:00:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2891186-ed17-46de-a29a-ea4803c9c62e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:00:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Flow 'volume_create_manager' (eec5d09b-d440-4581-8d9e-f40143b3a75b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:00:47 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-9f16370a-ab74-4b71-bc9d-bde043283f44 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Created volume successfully. Jul 08 01:00:49 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25aab75c-9d4f-4f22-b242-6f3b9ed44314 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Acquiring lock "cinder-052ae45f-8c0c-487c-9714-5fde9947997c-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:00:49 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25aab75c-9d4f-4f22-b242-6f3b9ed44314 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Lock "cinder-052ae45f-8c0c-487c-9714-5fde9947997c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:00:49 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25aab75c-9d4f-4f22-b242-6f3b9ed44314 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Acquiring lock "cinder-quobyte-052ae45f-8c0c-487c-9714-5fde9947997c" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:00:49 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25aab75c-9d4f-4f22-b242-6f3b9ed44314 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Lock "cinder-quobyte-052ae45f-8c0c-487c-9714-5fde9947997c" acquired by "delete_volume" :: waited 0.024s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:00:49 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e729687-adfc-4ca5-8d7d-818402595864]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:00:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25aab75c-9d4f-4f22-b242-6f3b9ed44314 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-052ae45f-8c0c-487c-9714-5fde9947997c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:50 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-052ae45f-8c0c-487c-9714-5fde9947997c Jul 08 01:00:50 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:50 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25aab75c-9d4f-4f22-b242-6f3b9ed44314 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-052ae45f-8c0c-487c-9714-5fde9947997c" returned: 0 in 1.053s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25aab75c-9d4f-4f22-b242-6f3b9ed44314 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-052ae45f-8c0c-487c-9714-5fde9947997c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:51 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-052ae45f-8c0c-487c-9714-5fde9947997c Jul 08 01:00:51 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:52 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25aab75c-9d4f-4f22-b242-6f3b9ed44314 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-052ae45f-8c0c-487c-9714-5fde9947997c" returned: 0 in 1.155s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25aab75c-9d4f-4f22-b242-6f3b9ed44314 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Lock "cinder-quobyte-052ae45f-8c0c-487c-9714-5fde9947997c" released by "delete_volume" :: held 2.279s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:00:52 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-25aab75c-9d4f-4f22-b242-6f3b9ed44314 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Created reservations ['bec502a6-7fa5-4088-a851-ba9033ebbb9c', '02eb9192-bbbd-4609-ad14-b401bc45d4fe', 'd40237ea-4520-47c4-a206-123000d249bf', 'd8559543-d787-4c13-8413-85bdb0032d86'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:00:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-25aab75c-9d4f-4f22-b242-6f3b9ed44314 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:00:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-25aab75c-9d4f-4f22-b242-6f3b9ed44314 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:00:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-25aab75c-9d4f-4f22-b242-6f3b9ed44314 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:00:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-25aab75c-9d4f-4f22-b242-6f3b9ed44314 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:00:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-25aab75c-9d4f-4f22-b242-6f3b9ed44314 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:00:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25aab75c-9d4f-4f22-b242-6f3b9ed44314 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:00:52 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:00:52 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:00:54 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Jul 08 01:00:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25aab75c-9d4f-4f22-b242-6f3b9ed44314 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.704s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:00:54 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-25aab75c-9d4f-4f22-b242-6f3b9ed44314 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:00:54 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-25aab75c-9d4f-4f22-b242-6f3b9ed44314 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Deleted volume successfully. Jul 08 01:00:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25aab75c-9d4f-4f22-b242-6f3b9ed44314 tempest-VolumeQuotasNegativeTestJSON-2013523980 None] Lock "cinder-052ae45f-8c0c-487c-9714-5fde9947997c-delete_volume" released by "delete_volume" :: held 4.610s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:01:06 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:01:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Flow 'volume_create_manager' (3ebab06a-f37d-4820-9e79-2b6bfb3cc290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:01:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab73ef3-2b42-4e72-83b1-482aae51e6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab73ef3-2b42-4e72-83b1-482aae51e6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:01:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1614856939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f411f175-0a02-4384-9ede-b46f5a1fa877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949627b21a9b4279959b06fc4153c94a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:01:07Z,use_quota=True,user_id='26d859610169443986cece47489f9c20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71f5eb18-e4d2-4d8c-b924-f6f5df1aa156),volume_type_id=71f5eb18-e4d2-4d8c-b924-f6f5df1aa156)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ecdb378-a066-4600-b5c0-ca19b58705bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ecdb378-a066-4600-b5c0-ca19b58705bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f330c7d7-ccc8-43c6-886b-fc9e059eee5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f330c7d7-ccc8-43c6-886b-fc9e059eee5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f411f175-0a02-4384-9ede-b46f5a1fa877', 'volume_name': 'volume-f411f175-0a02-4384-9ede-b46f5a1fa877', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c0683b-e832-4e94-b9ec-8faf80dff8df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c0683b-e832-4e94-b9ec-8faf80dff8df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42d59e90-1c06-44d1-95f2-abfac1ac577f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:06 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Volume f411f175-0a02-4384-9ede-b46f5a1fa877: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f411f175-0a02-4384-9ede-b46f5a1fa877', 'volume_size': 1} Jul 08 01:01:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:01:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:01:06 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:01:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1614856939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f411f175-0a02-4384-9ede-b46f5a1fa877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949627b21a9b4279959b06fc4153c94a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:01:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:01:07Z,use_quota=True,user_id='26d859610169443986cece47489f9c20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71f5eb18-e4d2-4d8c-b924-f6f5df1aa156),volume_type_id=71f5eb18-e4d2-4d8c-b924-f6f5df1aa156)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:01:06 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Creating volume f411f175-0a02-4384-9ede-b46f5a1fa877 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:01:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:01:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:01:06 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:01:06 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:01:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:01:06 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:01:06 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:01:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f411f175-0a02-4384-9ede-b46f5a1fa877 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:06 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f411f175-0a02-4384-9ede-b46f5a1fa877 1073741824 Jul 08 01:01:06 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:08 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f411f175-0a02-4384-9ede-b46f5a1fa877 1073741824" returned: 0 in 1.261s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f411f175-0a02-4384-9ede-b46f5a1fa877 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:08 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f411f175-0a02-4384-9ede-b46f5a1fa877 Jul 08 01:01:08 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:09 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f411f175-0a02-4384-9ede-b46f5a1fa877" returned: 0 in 1.022s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] <== create_volume: return (2342ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:01:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.344s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:01:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (42d59e90-1c06-44d1-95f2-abfac1ac577f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f411f175-0a02-4384-9ede-b46f5a1fa877', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1f7ec2-3dc0-49d6-8fa6-63f29dab78b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:09 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Volume volume-f411f175-0a02-4384-9ede-b46f5a1fa877 (f411f175-0a02-4384-9ede-b46f5a1fa877): created successfully Jul 08 01:01:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1f7ec2-3dc0-49d6-8fa6-63f29dab78b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Flow 'volume_create_manager' (3ebab06a-f37d-4820-9e79-2b6bfb3cc290) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:01:09 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-10458117-a7e4-46b8-ac77-daeb90bb6bcb tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Created volume successfully. Jul 08 01:01:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6c201dcf-053f-4371-a198-0b55ee493e41 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:01:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6c201dcf-053f-4371-a198-0b55ee493e41 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:01:10 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6c201dcf-053f-4371-a198-0b55ee493e41 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:01:10 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6c201dcf-053f-4371-a198-0b55ee493e41 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:01:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6c201dcf-053f-4371-a198-0b55ee493e41 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:01:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6c201dcf-053f-4371-a198-0b55ee493e41 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:10 devstack sudo[90023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:01:10 devstack sudo[90023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:11 devstack sudo[90023]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6c201dcf-053f-4371-a198-0b55ee493e41 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.895s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:11 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-6c201dcf-053f-4371-a198-0b55ee493e41 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:01:11 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-6c201dcf-053f-4371-a198-0b55ee493e41 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Retype volume completed successfully. Jul 08 01:01:12 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-08f89550-e6a8-4583-91e9-153ee26c90f4 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Acquiring lock "cinder-f411f175-0a02-4384-9ede-b46f5a1fa877-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:01:12 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-08f89550-e6a8-4583-91e9-153ee26c90f4 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Lock "cinder-f411f175-0a02-4384-9ede-b46f5a1fa877-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:01:12 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-08f89550-e6a8-4583-91e9-153ee26c90f4 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Acquiring lock "cinder-quobyte-f411f175-0a02-4384-9ede-b46f5a1fa877" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:01:12 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-08f89550-e6a8-4583-91e9-153ee26c90f4 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Lock "cinder-quobyte-f411f175-0a02-4384-9ede-b46f5a1fa877" acquired by "delete_volume" :: waited 0.028s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:01:12 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a93f22-4992-417a-99f1-348447c08a6f]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:01:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-08f89550-e6a8-4583-91e9-153ee26c90f4 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f411f175-0a02-4384-9ede-b46f5a1fa877 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:12 devstack sudo[90029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f411f175-0a02-4384-9ede-b46f5a1fa877 Jul 08 01:01:12 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:14 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-08f89550-e6a8-4583-91e9-153ee26c90f4 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f411f175-0a02-4384-9ede-b46f5a1fa877" returned: 0 in 2.058s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-08f89550-e6a8-4583-91e9-153ee26c90f4 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f411f175-0a02-4384-9ede-b46f5a1fa877 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:14 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f411f175-0a02-4384-9ede-b46f5a1fa877 Jul 08 01:01:14 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:15 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-08f89550-e6a8-4583-91e9-153ee26c90f4 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f411f175-0a02-4384-9ede-b46f5a1fa877" returned: 0 in 1.403s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:15 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-08f89550-e6a8-4583-91e9-153ee26c90f4 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Lock "cinder-quobyte-f411f175-0a02-4384-9ede-b46f5a1fa877" released by "delete_volume" :: held 3.551s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:01:15 devstack cinder-volume[87123]: WARNING cinder.quota [None req-08f89550-e6a8-4583-91e9-153ee26c90f4 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:01:15 devstack cinder-volume[87123]: WARNING cinder.quota [None req-08f89550-e6a8-4583-91e9-153ee26c90f4 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:01:15 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-08f89550-e6a8-4583-91e9-153ee26c90f4 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Created reservations ['c9a3a304-a611-44d3-bb71-2942ce5eb165', 'e5499448-bd39-4376-92cd-7a35ed10c1a6', 'e55e2bbb-b417-4abf-a8b2-f9e2e99f1393', 'cc8a3f26-74f1-4a9a-a3ea-fb0972d394d6'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:01:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-08f89550-e6a8-4583-91e9-153ee26c90f4 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:01:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-08f89550-e6a8-4583-91e9-153ee26c90f4 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:01:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-08f89550-e6a8-4583-91e9-153ee26c90f4 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:01:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-08f89550-e6a8-4583-91e9-153ee26c90f4 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:01:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-08f89550-e6a8-4583-91e9-153ee26c90f4 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:01:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-08f89550-e6a8-4583-91e9-153ee26c90f4 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:16 devstack sudo[90052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:01:16 devstack sudo[90052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:17 devstack sudo[90052]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-08f89550-e6a8-4583-91e9-153ee26c90f4 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.422s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:17 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-08f89550-e6a8-4583-91e9-153ee26c90f4 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:01:17 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-08f89550-e6a8-4583-91e9-153ee26c90f4 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Deleted volume successfully. Jul 08 01:01:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-08f89550-e6a8-4583-91e9-153ee26c90f4 tempest-VolumeRetypeWithoutMigrationTest-2069594335 None] Lock "cinder-f411f175-0a02-4384-9ede-b46f5a1fa877-delete_volume" released by "delete_volume" :: held 5.528s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:01:25 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:01:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Flow 'volume_create_manager' (49ed2f49-572a-42b6-919f-94cda45a321b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:01:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459d0741-7d28-499a-95b0-451b8cedf9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459d0741-7d28-499a-95b0-451b8cedf9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1533791033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b0a820-84a0-462d-9a14-877c2531dbea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b687156a92a43c1a3cea104d8976014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:01:25Z,use_quota=True,user_id='ff719ef3ba0948cebe9394e8cbd68607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04724d17-37e1-4ddc-adb6-07d343ddac0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04724d17-37e1-4ddc-adb6-07d343ddac0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a95288b-562e-4db2-b101-029a358a2094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a95288b-562e-4db2-b101-029a358a2094) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8b0a820-84a0-462d-9a14-877c2531dbea', 'volume_name': 'volume-c8b0a820-84a0-462d-9a14-877c2531dbea', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7ea298-1ec8-41b3-9ee2-2d3caf9080d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7ea298-1ec8-41b3-9ee2-2d3caf9080d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcab0fee-2dea-4736-b0c5-2ab6b16bc06f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:25 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Volume c8b0a820-84a0-462d-9a14-877c2531dbea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8b0a820-84a0-462d-9a14-877c2531dbea', 'volume_size': 1} Jul 08 01:01:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:01:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:01:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1533791033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8b0a820-84a0-462d-9a14-877c2531dbea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b687156a92a43c1a3cea104d8976014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:01:25Z,use_quota=True,user_id='ff719ef3ba0948cebe9394e8cbd68607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:01:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Creating volume c8b0a820-84a0-462d-9a14-877c2531dbea {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:01:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:01:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:01:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:01:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:01:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:01:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:01:25 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:01:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8b0a820-84a0-462d-9a14-877c2531dbea 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:25 devstack sudo[90113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8b0a820-84a0-462d-9a14-877c2531dbea 1073741824 Jul 08 01:01:25 devstack sudo[90113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:26 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=26,cinder:UPDATE=19,cinder:DELETE=3,cinder:INSERT=5 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:01:26 devstack sudo[90113]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8b0a820-84a0-462d-9a14-877c2531dbea 1073741824" returned: 0 in 1.290s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8b0a820-84a0-462d-9a14-877c2531dbea {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:26 devstack sudo[90131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8b0a820-84a0-462d-9a14-877c2531dbea Jul 08 01:01:26 devstack sudo[90131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:28 devstack sudo[90131]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8b0a820-84a0-462d-9a14-877c2531dbea" returned: 0 in 1.259s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:28 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] <== create_volume: return (2704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:01:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.709s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:01:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcab0fee-2dea-4736-b0c5-2ab6b16bc06f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8b0a820-84a0-462d-9a14-877c2531dbea', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5f6150-2183-40b4-9db9-c66549a7468d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:28 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Volume volume-c8b0a820-84a0-462d-9a14-877c2531dbea (c8b0a820-84a0-462d-9a14-877c2531dbea): created successfully Jul 08 01:01:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5f6150-2183-40b4-9db9-c66549a7468d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Flow 'volume_create_manager' (49ed2f49-572a-42b6-919f-94cda45a321b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:01:28 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-822192e2-3bc8-49ab-8cab-e8d1ca6eb7d3 tempest-ServersNegativeTestJSON-1224199642 None] Created volume successfully. Jul 08 01:01:30 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:01:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Flow 'volume_create_manager' (2e4334db-e93d-4699-8611-526fd4c827e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:01:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8689834-e80d-44dd-9945-ee2c036fb482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8689834-e80d-44dd-9945-ee2c036fb482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1957148803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f61373-57d3-4887-9ae6-ed7aaee29b16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b687156a92a43c1a3cea104d8976014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:01:30Z,use_quota=True,user_id='ff719ef3ba0948cebe9394e8cbd68607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b54b22-2b27-4e23-ade1-1d0f03f59ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4b54b22-2b27-4e23-ade1-1d0f03f59ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53dd6d8-5e99-4db3-a7f0-b9d4157cc058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c53dd6d8-5e99-4db3-a7f0-b9d4157cc058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0f61373-57d3-4887-9ae6-ed7aaee29b16', 'volume_name': 'volume-f0f61373-57d3-4887-9ae6-ed7aaee29b16', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612e143f-11d1-4d78-8814-fa96f9400c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (612e143f-11d1-4d78-8814-fa96f9400c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94cc5fd-7157-4c52-9746-688bab77e82e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:30 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Volume f0f61373-57d3-4887-9ae6-ed7aaee29b16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0f61373-57d3-4887-9ae6-ed7aaee29b16', 'volume_size': 1} Jul 08 01:01:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:01:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:01:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1957148803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0f61373-57d3-4887-9ae6-ed7aaee29b16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b687156a92a43c1a3cea104d8976014',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:01:30Z,use_quota=True,user_id='ff719ef3ba0948cebe9394e8cbd68607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:01:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Creating volume f0f61373-57d3-4887-9ae6-ed7aaee29b16 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:01:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:01:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:01:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:01:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:01:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:01:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:01:30 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:01:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f0f61373-57d3-4887-9ae6-ed7aaee29b16 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:30 devstack sudo[90213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f0f61373-57d3-4887-9ae6-ed7aaee29b16 1073741824 Jul 08 01:01:30 devstack sudo[90213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:31 devstack sudo[90213]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f0f61373-57d3-4887-9ae6-ed7aaee29b16 1073741824" returned: 0 in 1.140s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f0f61373-57d3-4887-9ae6-ed7aaee29b16 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:32 devstack sudo[90219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f0f61373-57d3-4887-9ae6-ed7aaee29b16 Jul 08 01:01:32 devstack sudo[90219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:33 devstack sudo[90219]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f0f61373-57d3-4887-9ae6-ed7aaee29b16" returned: 0 in 1.171s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] <== create_volume: return (2400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:01:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.404s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:01:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e94cc5fd-7157-4c52-9746-688bab77e82e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0f61373-57d3-4887-9ae6-ed7aaee29b16', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5411671-4847-42a0-bdb5-906b744ba43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:33 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Volume volume-f0f61373-57d3-4887-9ae6-ed7aaee29b16 (f0f61373-57d3-4887-9ae6-ed7aaee29b16): created successfully Jul 08 01:01:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5411671-4847-42a0-bdb5-906b744ba43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Flow 'volume_create_manager' (2e4334db-e93d-4699-8611-526fd4c827e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:01:33 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-da261e81-86b6-4cb7-abb1-7bd3f11f2c66 tempest-ServersNegativeTestJSON-1224199642 None] Created volume successfully. Jul 08 01:01:35 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c561a607-2d7a-44cb-9046-6341156445be tempest-ServersNegativeTestJSON-1224199642 None] Acquiring lock "cinder-f0f61373-57d3-4887-9ae6-ed7aaee29b16-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:01:35 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c561a607-2d7a-44cb-9046-6341156445be tempest-ServersNegativeTestJSON-1224199642 None] Lock "cinder-f0f61373-57d3-4887-9ae6-ed7aaee29b16-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:01:35 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c561a607-2d7a-44cb-9046-6341156445be tempest-ServersNegativeTestJSON-1224199642 None] Acquiring lock "cinder-quobyte-f0f61373-57d3-4887-9ae6-ed7aaee29b16" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:01:35 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c561a607-2d7a-44cb-9046-6341156445be tempest-ServersNegativeTestJSON-1224199642 None] Lock "cinder-quobyte-f0f61373-57d3-4887-9ae6-ed7aaee29b16" acquired by "delete_volume" :: waited 0.041s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:01:35 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9461c5d-3da6-479f-b236-dcd30be62cd7]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:01:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c561a607-2d7a-44cb-9046-6341156445be tempest-ServersNegativeTestJSON-1224199642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f0f61373-57d3-4887-9ae6-ed7aaee29b16 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:36 devstack sudo[90225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f0f61373-57d3-4887-9ae6-ed7aaee29b16 Jul 08 01:01:36 devstack sudo[90225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:37 devstack sudo[90225]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c561a607-2d7a-44cb-9046-6341156445be tempest-ServersNegativeTestJSON-1224199642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f0f61373-57d3-4887-9ae6-ed7aaee29b16" returned: 0 in 1.292s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c561a607-2d7a-44cb-9046-6341156445be tempest-ServersNegativeTestJSON-1224199642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f0f61373-57d3-4887-9ae6-ed7aaee29b16 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:37 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f0f61373-57d3-4887-9ae6-ed7aaee29b16 Jul 08 01:01:37 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:38 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c561a607-2d7a-44cb-9046-6341156445be tempest-ServersNegativeTestJSON-1224199642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f0f61373-57d3-4887-9ae6-ed7aaee29b16" returned: 0 in 1.034s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c561a607-2d7a-44cb-9046-6341156445be tempest-ServersNegativeTestJSON-1224199642 None] Lock "cinder-quobyte-f0f61373-57d3-4887-9ae6-ed7aaee29b16" released by "delete_volume" :: held 2.418s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:01:38 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:UPDATE=43,cinder:SELECT=23,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:01:38 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-c561a607-2d7a-44cb-9046-6341156445be tempest-ServersNegativeTestJSON-1224199642 None] Created reservations ['015ecb3b-46b5-4b25-b9dd-ed6d297f1ede', '74f3628d-980d-4c46-8337-9cbb20bedbf4', 'fa74d658-b498-426a-bf57-55ce57b93029', '33190f2f-6acb-4058-ba53-19149d6f25dc'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:01:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c561a607-2d7a-44cb-9046-6341156445be tempest-ServersNegativeTestJSON-1224199642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:01:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c561a607-2d7a-44cb-9046-6341156445be tempest-ServersNegativeTestJSON-1224199642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:01:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c561a607-2d7a-44cb-9046-6341156445be tempest-ServersNegativeTestJSON-1224199642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:01:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c561a607-2d7a-44cb-9046-6341156445be tempest-ServersNegativeTestJSON-1224199642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:01:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c561a607-2d7a-44cb-9046-6341156445be tempest-ServersNegativeTestJSON-1224199642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:01:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c561a607-2d7a-44cb-9046-6341156445be tempest-ServersNegativeTestJSON-1224199642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:38 devstack sudo[90233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:01:38 devstack sudo[90233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a0f56418-acde-492f-abf5-8d681a1e1429 tempest-ServersNegativeTestJSON-1224199642 None] Acquiring lock "cinder-c8b0a820-84a0-462d-9a14-877c2531dbea-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:01:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a0f56418-acde-492f-abf5-8d681a1e1429 tempest-ServersNegativeTestJSON-1224199642 None] Lock "cinder-c8b0a820-84a0-462d-9a14-877c2531dbea-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:01:39 devstack sudo[90233]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c561a607-2d7a-44cb-9046-6341156445be tempest-ServersNegativeTestJSON-1224199642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.853s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:39 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-c561a607-2d7a-44cb-9046-6341156445be tempest-ServersNegativeTestJSON-1224199642 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:01:39 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-c561a607-2d7a-44cb-9046-6341156445be tempest-ServersNegativeTestJSON-1224199642 None] Deleted volume successfully. Jul 08 01:01:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a0f56418-acde-492f-abf5-8d681a1e1429 tempest-ServersNegativeTestJSON-1224199642 None] Acquiring lock "cinder-quobyte-c8b0a820-84a0-462d-9a14-877c2531dbea" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:01:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c561a607-2d7a-44cb-9046-6341156445be tempest-ServersNegativeTestJSON-1224199642 None] Lock "cinder-f0f61373-57d3-4887-9ae6-ed7aaee29b16-delete_volume" released by "delete_volume" :: held 3.713s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:01:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a0f56418-acde-492f-abf5-8d681a1e1429 tempest-ServersNegativeTestJSON-1224199642 None] Lock "cinder-quobyte-c8b0a820-84a0-462d-9a14-877c2531dbea" acquired by "delete_volume" :: waited 0.065s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:01:39 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdda3104-1526-4d28-8b9f-b271c6331167]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:01:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a0f56418-acde-492f-abf5-8d681a1e1429 tempest-ServersNegativeTestJSON-1224199642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8b0a820-84a0-462d-9a14-877c2531dbea {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:39 devstack sudo[90237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8b0a820-84a0-462d-9a14-877c2531dbea Jul 08 01:01:39 devstack sudo[90237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:40 devstack sudo[90237]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a0f56418-acde-492f-abf5-8d681a1e1429 tempest-ServersNegativeTestJSON-1224199642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8b0a820-84a0-462d-9a14-877c2531dbea" returned: 0 in 1.320s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a0f56418-acde-492f-abf5-8d681a1e1429 tempest-ServersNegativeTestJSON-1224199642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8b0a820-84a0-462d-9a14-877c2531dbea {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:40 devstack sudo[90245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8b0a820-84a0-462d-9a14-877c2531dbea Jul 08 01:01:40 devstack sudo[90245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Flow 'volume_create_manager' (8ec35a03-05f9-4d8b-8253-d7c2fac1ec27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93429ea9-a185-46f4-a30c-149b20efdf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93429ea9-a185-46f4-a30c-149b20efdf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-223210730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6d8329-5a71-4882-a299-9705b1410253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ea5aa9111d4368ad03f048a2fdb951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:01:41Z,use_quota=True,user_id='8078ad38ce5649a9a8b6e0b332fd89a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a4eae6-34f2-4d56-afab-a908567bb2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72a4eae6-34f2-4d56-afab-a908567bb2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09568fce-f28a-4ecb-a717-5b5db6fee8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09568fce-f28a-4ecb-a717-5b5db6fee8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae6d8329-5a71-4882-a299-9705b1410253', 'volume_name': 'volume-ae6d8329-5a71-4882-a299-9705b1410253', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37e6148-de94-4b6c-ab21-b7efc0e74804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d37e6148-de94-4b6c-ab21-b7efc0e74804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d25446a1-2ae6-49c5-8139-c9492a617cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:41 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Volume ae6d8329-5a71-4882-a299-9705b1410253: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae6d8329-5a71-4882-a299-9705b1410253', 'volume_size': 1} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:01:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-223210730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae6d8329-5a71-4882-a299-9705b1410253,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='02ea5aa9111d4368ad03f048a2fdb951',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:01:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:01:41Z,use_quota=True,user_id='8078ad38ce5649a9a8b6e0b332fd89a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Creating volume ae6d8329-5a71-4882-a299-9705b1410253 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:01:41 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ae6d8329-5a71-4882-a299-9705b1410253 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:41 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ae6d8329-5a71-4882-a299-9705b1410253 1073741824 Jul 08 01:01:41 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:41 devstack sudo[90245]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a0f56418-acde-492f-abf5-8d681a1e1429 tempest-ServersNegativeTestJSON-1224199642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8b0a820-84a0-462d-9a14-877c2531dbea" returned: 0 in 0.892s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a0f56418-acde-492f-abf5-8d681a1e1429 tempest-ServersNegativeTestJSON-1224199642 None] Lock "cinder-quobyte-c8b0a820-84a0-462d-9a14-877c2531dbea" released by "delete_volume" :: held 2.276s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-a0f56418-acde-492f-abf5-8d681a1e1429 tempest-ServersNegativeTestJSON-1224199642 None] Created reservations ['0772ca21-828b-46b4-b37d-480d71566fb3', '6ca048b3-6ce2-4068-8e1e-e41b608f5680', 'f17db1ed-f36a-4fdd-8b08-524948ec9155', '15530e64-5043-4afd-8286-6c8f089f9b8d'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a0f56418-acde-492f-abf5-8d681a1e1429 tempest-ServersNegativeTestJSON-1224199642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a0f56418-acde-492f-abf5-8d681a1e1429 tempest-ServersNegativeTestJSON-1224199642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a0f56418-acde-492f-abf5-8d681a1e1429 tempest-ServersNegativeTestJSON-1224199642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a0f56418-acde-492f-abf5-8d681a1e1429 tempest-ServersNegativeTestJSON-1224199642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a0f56418-acde-492f-abf5-8d681a1e1429 tempest-ServersNegativeTestJSON-1224199642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:01:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a0f56418-acde-492f-abf5-8d681a1e1429 tempest-ServersNegativeTestJSON-1224199642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:41 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:01:41 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:42 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ae6d8329-5a71-4882-a299-9705b1410253 1073741824" returned: 0 in 1.337s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ae6d8329-5a71-4882-a299-9705b1410253 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:42 devstack sudo[90257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ae6d8329-5a71-4882-a299-9705b1410253 Jul 08 01:01:42 devstack sudo[90257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:42 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a0f56418-acde-492f-abf5-8d681a1e1429 tempest-ServersNegativeTestJSON-1224199642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.090s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:43 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-a0f56418-acde-492f-abf5-8d681a1e1429 tempest-ServersNegativeTestJSON-1224199642 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:01:43 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-a0f56418-acde-492f-abf5-8d681a1e1429 tempest-ServersNegativeTestJSON-1224199642 None] Deleted volume successfully. Jul 08 01:01:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a0f56418-acde-492f-abf5-8d681a1e1429 tempest-ServersNegativeTestJSON-1224199642 None] Lock "cinder-c8b0a820-84a0-462d-9a14-877c2531dbea-delete_volume" released by "delete_volume" :: held 3.810s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:01:43 devstack sudo[90257]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ae6d8329-5a71-4882-a299-9705b1410253" returned: 0 in 1.151s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] <== create_volume: return (2587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:01:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.591s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:01:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d25446a1-2ae6-49c5-8139-c9492a617cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae6d8329-5a71-4882-a299-9705b1410253', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02dd5273-dd71-4814-83b4-0cc2f53de0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:43 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Volume volume-ae6d8329-5a71-4882-a299-9705b1410253 (ae6d8329-5a71-4882-a299-9705b1410253): created successfully Jul 08 01:01:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02dd5273-dd71-4814-83b4-0cc2f53de0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Flow 'volume_create_manager' (8ec35a03-05f9-4d8b-8253-d7c2fac1ec27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:01:43 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-5d2a2997-7bf2-497c-bff3-24272417c332 tempest-AttachVolumeShelveTestJSON-1398869319 None] Created volume successfully. Jul 08 01:01:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:01:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:01:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:01:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:01:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:01:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:01:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:45 devstack sudo[90296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:01:45 devstack sudo[90296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:01:46 devstack sudo[90296]: pam_unix(sudo:session): session closed for user root Jul 08 01:01:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.212s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:01:46 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:01:46 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:01:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 8 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:01:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:01:53 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:UPDATE=20,cinder:SELECT=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:01:54 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=17,cinder:UPDATE=22,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:01:59 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:01:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Flow 'volume_create_manager' (02af0aca-727d-4181-a31c-e040ec1f1064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:01:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8db4189-5709-4a1a-9b63-71551905730d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8db4189-5709-4a1a-9b63-71551905730d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-856994977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=987ecbdb-211d-43e1-a024-b48a915f7fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d1530ea6a5646dbb98e1c2a6aea544a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:01:59Z,use_quota=True,user_id='fbad416ec8624cd281a05d2e652279d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a748cf3-6475-45fc-8ef3-fa05dd7e3550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a748cf3-6475-45fc-8ef3-fa05dd7e3550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8c5a21-ba16-437e-b8d4-fef4e47f9d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e8c5a21-ba16-437e-b8d4-fef4e47f9d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '987ecbdb-211d-43e1-a024-b48a915f7fa7', 'volume_name': 'volume-987ecbdb-211d-43e1-a024-b48a915f7fa7', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10bb52d-576a-46b3-8957-4cb083c415e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a10bb52d-576a-46b3-8957-4cb083c415e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:01:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5da3ece-0840-4d3e-94ee-f4bb601888fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:01:59 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Volume 987ecbdb-211d-43e1-a024-b48a915f7fa7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-987ecbdb-211d-43e1-a024-b48a915f7fa7', 'volume_size': 1} Jul 08 01:01:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:01:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:01:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-856994977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=987ecbdb-211d-43e1-a024-b48a915f7fa7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d1530ea6a5646dbb98e1c2a6aea544a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:01:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:01:59Z,use_quota=True,user_id='fbad416ec8624cd281a05d2e652279d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:01:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Creating volume 987ecbdb-211d-43e1-a024-b48a915f7fa7 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:01:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:01:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:01:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:01:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:01:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:01:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:01:59 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:01:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-987ecbdb-211d-43e1-a024-b48a915f7fa7 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:01:59 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-987ecbdb-211d-43e1-a024-b48a915f7fa7 1073741824 Jul 08 01:01:59 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:02:00 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Jul 08 01:02:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-987ecbdb-211d-43e1-a024-b48a915f7fa7 1073741824" returned: 0 in 1.298s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:02:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-987ecbdb-211d-43e1-a024-b48a915f7fa7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:02:00 devstack sudo[90361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-987ecbdb-211d-43e1-a024-b48a915f7fa7 Jul 08 01:02:00 devstack sudo[90361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:02:01 devstack sudo[90361]: pam_unix(sudo:session): session closed for user root Jul 08 01:02:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-987ecbdb-211d-43e1-a024-b48a915f7fa7" returned: 0 in 1.023s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:02:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] <== create_volume: return (2395ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:02:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.398s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:02:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5da3ece-0840-4d3e-94ee-f4bb601888fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-987ecbdb-211d-43e1-a024-b48a915f7fa7', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:02:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e003b94-b0a4-4af0-b727-38eadb45abd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:02:01 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Volume volume-987ecbdb-211d-43e1-a024-b48a915f7fa7 (987ecbdb-211d-43e1-a024-b48a915f7fa7): created successfully Jul 08 01:02:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e003b94-b0a4-4af0-b727-38eadb45abd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:02:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Flow 'volume_create_manager' (02af0aca-727d-4181-a31c-e040ec1f1064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:02:01 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-e4eed2e3-fa70-47ce-b432-b3468a82f720 tempest-ServerActionsTestOtherA-2051284359 None] Created volume successfully. Jul 08 01:02:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-1019a133-f046-419a-a48b-01163d130ef1 req-a0c140e2-1cc6-47b9-abd9-d8e6f1af4508 tempest-AttachVolumeShelveTestJSON-1398869319 None] No connector for attachment acda9674-2b6a-4afc-994d-685cf410884d; skipping storage backend terminate_connection call. {{(pid=87123) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 08 01:02:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-1019a133-f046-419a-a48b-01163d130ef1 req-a0c140e2-1cc6-47b9-abd9-d8e6f1af4508 tempest-AttachVolumeShelveTestJSON-1398869319 None] Deleting attachment acda9674-2b6a-4afc-994d-685cf410884d. {{(pid=87123) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:02:16 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2,cinder:INSERT=1 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:02:16 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=4,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:02:25 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:02:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Flow 'volume_create_manager' (f010d660-b0f5-4269-8355-645e2dd8cbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:02:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2338a9-c70a-4de9-9e13-9a234475e9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:02:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef2338a9-c70a-4de9-9e13-9a234475e9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1531130866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=460d96fd-b1a2-48d5-9d55-be1d052ac8ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394c75e7409d4b23a5f4ecbf7c46deb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:02:25Z,use_quota=True,user_id='a821541c7f194fd4acb41674ec7b6b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:02:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490e3f69-0c32-4b86-911b-9471478fb662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:02:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490e3f69-0c32-4b86-911b-9471478fb662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:02:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15cf4643-cbbf-4188-b979-01fa410180eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:02:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15cf4643-cbbf-4188-b979-01fa410180eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '460d96fd-b1a2-48d5-9d55-be1d052ac8ce', 'volume_name': 'volume-460d96fd-b1a2-48d5-9d55-be1d052ac8ce', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:02:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1bca96-7874-4e71-acf0-fcdaeadb1fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:02:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1bca96-7874-4e71-acf0-fcdaeadb1fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:02:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c99f2e-9913-456b-a2bc-7ad934b3abbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:02:25 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Volume 460d96fd-b1a2-48d5-9d55-be1d052ac8ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-460d96fd-b1a2-48d5-9d55-be1d052ac8ce', 'volume_size': 1} Jul 08 01:02:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:02:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:02:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1531130866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=460d96fd-b1a2-48d5-9d55-be1d052ac8ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394c75e7409d4b23a5f4ecbf7c46deb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:02:25Z,use_quota=True,user_id='a821541c7f194fd4acb41674ec7b6b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:02:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Creating volume 460d96fd-b1a2-48d5-9d55-be1d052ac8ce {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:02:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:02:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:02:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:02:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:02:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:02:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:02:25 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:02:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-460d96fd-b1a2-48d5-9d55-be1d052ac8ce 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:02:25 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-460d96fd-b1a2-48d5-9d55-be1d052ac8ce 1073741824 Jul 08 01:02:25 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:02:28 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Jul 08 01:02:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-460d96fd-b1a2-48d5-9d55-be1d052ac8ce 1073741824" returned: 0 in 2.679s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:02:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-460d96fd-b1a2-48d5-9d55-be1d052ac8ce {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:02:28 devstack sudo[90620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-460d96fd-b1a2-48d5-9d55-be1d052ac8ce Jul 08 01:02:28 devstack sudo[90620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:02:29 devstack sudo[90620]: pam_unix(sudo:session): session closed for user root Jul 08 01:02:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-460d96fd-b1a2-48d5-9d55-be1d052ac8ce" returned: 0 in 1.495s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:02:29 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] <== create_volume: return (4305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:02:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.315s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:02:29 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c99f2e-9913-456b-a2bc-7ad934b3abbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-460d96fd-b1a2-48d5-9d55-be1d052ac8ce', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:02:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2da8bf-07b1-4604-8573-1a23a03980f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:02:30 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Volume volume-460d96fd-b1a2-48d5-9d55-be1d052ac8ce (460d96fd-b1a2-48d5-9d55-be1d052ac8ce): created successfully Jul 08 01:02:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be2da8bf-07b1-4604-8573-1a23a03980f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:02:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Flow 'volume_create_manager' (f010d660-b0f5-4269-8355-645e2dd8cbe5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:02:30 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-2eaf5e35-bf30-43a6-a408-3907a03fe6ac tempest-VolumesActionsTest-680111013 None] Created volume successfully. Jul 08 01:02:31 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4ab57596-7b02-46e5-8468-b046d49c0d65 tempest-VolumesActionsTest-680111013 None] Acquiring lock "cinder-460d96fd-b1a2-48d5-9d55-be1d052ac8ce" by "attach_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:02:31 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4ab57596-7b02-46e5-8468-b046d49c0d65 tempest-VolumesActionsTest-680111013 None] Lock "cinder-460d96fd-b1a2-48d5-9d55-be1d052ac8ce" acquired by "attach_volume" :: waited 0.075s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:02:31 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-4ab57596-7b02-46e5-8468-b046d49c0d65 tempest-VolumesActionsTest-680111013 None] Attaching volume 460d96fd-b1a2-48d5-9d55-be1d052ac8ce to instance 0084b322-ce13-4118-a7a5-98a8faa9acde at mountpoint /dev/vdb on host None. Jul 08 01:02:31 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-4ab57596-7b02-46e5-8468-b046d49c0d65 tempest-VolumesActionsTest-680111013 None] Attach volume completed successfully. Jul 08 01:02:31 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4ab57596-7b02-46e5-8468-b046d49c0d65 tempest-VolumesActionsTest-680111013 None] Lock "cinder-460d96fd-b1a2-48d5-9d55-be1d052ac8ce" released by "attach_volume" :: held 0.321s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:02:33 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-c1c43dbc-ec54-45ca-b168-d04a78e94b7d tempest-VolumesActionsTest-345274021 None] Terminate volume connection completed successfully. Jul 08 01:02:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c1c43dbc-ec54-45ca-b168-d04a78e94b7d tempest-VolumesActionsTest-345274021 None] Acquiring lock "cinder-460d96fd-b1a2-48d5-9d55-be1d052ac8ce-detach_volume" by "detach_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:02:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c1c43dbc-ec54-45ca-b168-d04a78e94b7d tempest-VolumesActionsTest-345274021 None] Lock "cinder-460d96fd-b1a2-48d5-9d55-be1d052ac8ce-detach_volume" acquired by "detach_volume" :: waited 0.070s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:02:33 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-c1c43dbc-ec54-45ca-b168-d04a78e94b7d tempest-VolumesActionsTest-345274021 None] Detaching volume 460d96fd-b1a2-48d5-9d55-be1d052ac8ce from instance 0084b322-ce13-4118-a7a5-98a8faa9acde. Jul 08 01:02:34 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-c1c43dbc-ec54-45ca-b168-d04a78e94b7d tempest-VolumesActionsTest-345274021 None] Detach volume completed successfully. Jul 08 01:02:34 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c1c43dbc-ec54-45ca-b168-d04a78e94b7d tempest-VolumesActionsTest-345274021 None] Lock "cinder-460d96fd-b1a2-48d5-9d55-be1d052ac8ce-detach_volume" released by "detach_volume" :: held 0.108s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:02:35 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-24b24987-02c4-42d7-88b2-f6ece270546a tempest-VolumesActionsTest-680111013 None] Acquiring lock "cinder-460d96fd-b1a2-48d5-9d55-be1d052ac8ce-detach_volume" by "detach_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:02:35 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-24b24987-02c4-42d7-88b2-f6ece270546a tempest-VolumesActionsTest-680111013 None] Lock "cinder-460d96fd-b1a2-48d5-9d55-be1d052ac8ce-detach_volume" acquired by "detach_volume" :: waited 0.095s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:02:35 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-24b24987-02c4-42d7-88b2-f6ece270546a tempest-VolumesActionsTest-680111013 None] Volume detach called, but volume not attached. Jul 08 01:02:35 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-24b24987-02c4-42d7-88b2-f6ece270546a tempest-VolumesActionsTest-680111013 None] Lock "cinder-460d96fd-b1a2-48d5-9d55-be1d052ac8ce-detach_volume" released by "detach_volume" :: held 0.134s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:02:36 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3f9d8895-5b11-4a6a-9ac6-95018fcab55a tempest-VolumesActionsTest-680111013 None] Acquiring lock "cinder-460d96fd-b1a2-48d5-9d55-be1d052ac8ce-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:02:36 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3f9d8895-5b11-4a6a-9ac6-95018fcab55a tempest-VolumesActionsTest-680111013 None] Lock "cinder-460d96fd-b1a2-48d5-9d55-be1d052ac8ce-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:02:36 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3f9d8895-5b11-4a6a-9ac6-95018fcab55a tempest-VolumesActionsTest-680111013 None] Acquiring lock "cinder-quobyte-460d96fd-b1a2-48d5-9d55-be1d052ac8ce" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:02:36 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3f9d8895-5b11-4a6a-9ac6-95018fcab55a tempest-VolumesActionsTest-680111013 None] Lock "cinder-quobyte-460d96fd-b1a2-48d5-9d55-be1d052ac8ce" acquired by "delete_volume" :: waited 0.058s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:02:37 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bbc7a4-6d3b-4181-9fb9-05d915e9eaef]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:02:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f9d8895-5b11-4a6a-9ac6-95018fcab55a tempest-VolumesActionsTest-680111013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-460d96fd-b1a2-48d5-9d55-be1d052ac8ce {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:02:37 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-460d96fd-b1a2-48d5-9d55-be1d052ac8ce Jul 08 01:02:37 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:02:38 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Jul 08 01:02:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f9d8895-5b11-4a6a-9ac6-95018fcab55a tempest-VolumesActionsTest-680111013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-460d96fd-b1a2-48d5-9d55-be1d052ac8ce" returned: 0 in 1.726s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:02:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f9d8895-5b11-4a6a-9ac6-95018fcab55a tempest-VolumesActionsTest-680111013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-460d96fd-b1a2-48d5-9d55-be1d052ac8ce {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:02:38 devstack sudo[90777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-460d96fd-b1a2-48d5-9d55-be1d052ac8ce Jul 08 01:02:38 devstack sudo[90777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:02:40 devstack sudo[90777]: pam_unix(sudo:session): session closed for user root Jul 08 01:02:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f9d8895-5b11-4a6a-9ac6-95018fcab55a tempest-VolumesActionsTest-680111013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-460d96fd-b1a2-48d5-9d55-be1d052ac8ce" returned: 0 in 1.685s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:02:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3f9d8895-5b11-4a6a-9ac6-95018fcab55a tempest-VolumesActionsTest-680111013 None] Lock "cinder-quobyte-460d96fd-b1a2-48d5-9d55-be1d052ac8ce" released by "delete_volume" :: held 3.543s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:02:40 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-3f9d8895-5b11-4a6a-9ac6-95018fcab55a tempest-VolumesActionsTest-680111013 None] Created reservations ['59ed4e1b-faf3-4c85-887e-a9d0fcb82327', '7b87029c-456c-49f3-8a5a-40509b679d22', 'bd845564-64bd-4a58-bdc4-1e2d87040510', '3b60b6a8-0ad7-4f75-b367-b42756a948e4'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:02:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3f9d8895-5b11-4a6a-9ac6-95018fcab55a tempest-VolumesActionsTest-680111013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:02:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3f9d8895-5b11-4a6a-9ac6-95018fcab55a tempest-VolumesActionsTest-680111013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:02:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3f9d8895-5b11-4a6a-9ac6-95018fcab55a tempest-VolumesActionsTest-680111013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:02:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3f9d8895-5b11-4a6a-9ac6-95018fcab55a tempest-VolumesActionsTest-680111013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:02:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3f9d8895-5b11-4a6a-9ac6-95018fcab55a tempest-VolumesActionsTest-680111013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:02:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f9d8895-5b11-4a6a-9ac6-95018fcab55a tempest-VolumesActionsTest-680111013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:02:40 devstack sudo[90782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:02:40 devstack sudo[90782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:02:41 devstack sudo[90782]: pam_unix(sudo:session): session closed for user root Jul 08 01:02:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f9d8895-5b11-4a6a-9ac6-95018fcab55a tempest-VolumesActionsTest-680111013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.034s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:02:41 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-3f9d8895-5b11-4a6a-9ac6-95018fcab55a tempest-VolumesActionsTest-680111013 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:02:41 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-3f9d8895-5b11-4a6a-9ac6-95018fcab55a tempest-VolumesActionsTest-680111013 None] Deleted volume successfully. Jul 08 01:02:41 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3f9d8895-5b11-4a6a-9ac6-95018fcab55a tempest-VolumesActionsTest-680111013 None] Lock "cinder-460d96fd-b1a2-48d5-9d55-be1d052ac8ce-delete_volume" released by "delete_volume" :: held 5.166s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:02:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:02:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:02:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:02:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:02:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:02:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:02:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:02:44 devstack sudo[90866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:02:44 devstack sudo[90866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:02:46 devstack sudo[90866]: pam_unix(sudo:session): session closed for user root Jul 08 01:02:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.275s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:02:46 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:02:46 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:02:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 8 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:02:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:02:50 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=12,cinder:UPDATE=18,cinder:INSERT=3 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:02:51 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:UPDATE=11,cinder:SELECT=17,cinder:DELETE=2,cinder:INSERT=4 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:02:52 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:02:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Flow 'volume_create_manager' (d7ca55b8-0a25-46fb-969a-5eb29c481701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:02:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf0697e6-106b-4c17-b8c0-172b804c95ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:02:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf0697e6-106b-4c17-b8c0-172b804c95ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-204046456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683e5d08-2987-457a-9dd7-207967f5981e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394c75e7409d4b23a5f4ecbf7c46deb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:02:53Z,use_quota=True,user_id='a821541c7f194fd4acb41674ec7b6b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:02:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf20237-0440-45a9-b109-4562f6184073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:02:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cf20237-0440-45a9-b109-4562f6184073) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:02:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7257ca7c-d5b7-4063-a68c-42af90c6720e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:02:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7257ca7c-d5b7-4063-a68c-42af90c6720e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '683e5d08-2987-457a-9dd7-207967f5981e', 'volume_name': 'volume-683e5d08-2987-457a-9dd7-207967f5981e', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:02:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcecba60-ced0-44f6-99c3-6ca25fa3988a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:02:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcecba60-ced0-44f6-99c3-6ca25fa3988a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:02:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c41685d3-c8f5-4af9-a7e7-0636942ddd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:02:52 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Volume 683e5d08-2987-457a-9dd7-207967f5981e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-683e5d08-2987-457a-9dd7-207967f5981e', 'volume_size': 1} Jul 08 01:02:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:02:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:02:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-204046456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=683e5d08-2987-457a-9dd7-207967f5981e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394c75e7409d4b23a5f4ecbf7c46deb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:02:53Z,use_quota=True,user_id='a821541c7f194fd4acb41674ec7b6b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:02:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Creating volume 683e5d08-2987-457a-9dd7-207967f5981e {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:02:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:02:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:02:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:02:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:02:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:02:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:02:52 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:02:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-683e5d08-2987-457a-9dd7-207967f5981e 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:02:52 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-683e5d08-2987-457a-9dd7-207967f5981e 1073741824 Jul 08 01:02:52 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:02:54 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Jul 08 01:02:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-683e5d08-2987-457a-9dd7-207967f5981e 1073741824" returned: 0 in 1.258s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:02:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-683e5d08-2987-457a-9dd7-207967f5981e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:02:54 devstack sudo[90973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-683e5d08-2987-457a-9dd7-207967f5981e Jul 08 01:02:54 devstack sudo[90973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:02:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-06aca908-9a04-42c9-9f2a-b9f961511f4e req-2c7eb2d0-85be-42c0-99f7-f8f8ba72f1f7 tempest-ServerActionsTestOtherA-2051284359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:02:55 devstack sudo[90973]: pam_unix(sudo:session): session closed for user root Jul 08 01:02:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-683e5d08-2987-457a-9dd7-207967f5981e" returned: 0 in 1.009s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:02:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] <== create_volume: return (2338ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:02:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.343s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:02:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-06aca908-9a04-42c9-9f2a-b9f961511f4e req-2c7eb2d0-85be-42c0-99f7-f8f8ba72f1f7 tempest-ServerActionsTestOtherA-2051284359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.309s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:02:55 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c41685d3-c8f5-4af9-a7e7-0636942ddd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-683e5d08-2987-457a-9dd7-207967f5981e', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:02:55 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6941d58-af6c-4746-b96f-9e0741b097b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:02:55 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe090a27-1a7c-479a-a3ff-c3c3b433d9c0]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:02:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-06aca908-9a04-42c9-9f2a-b9f961511f4e req-2c7eb2d0-85be-42c0-99f7-f8f8ba72f1f7 tempest-ServerActionsTestOtherA-2051284359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-987ecbdb-211d-43e1-a024-b48a915f7fa7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:02:55 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Volume volume-683e5d08-2987-457a-9dd7-207967f5981e (683e5d08-2987-457a-9dd7-207967f5981e): created successfully Jul 08 01:02:55 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6941d58-af6c-4746-b96f-9e0741b097b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:02:55 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Flow 'volume_create_manager' (d7ca55b8-0a25-46fb-969a-5eb29c481701) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:02:55 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-2523d387-8140-4f53-b3f0-2a95a9641711 tempest-VolumesActionsTest-680111013 None] Created volume successfully. Jul 08 01:02:55 devstack sudo[91001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-987ecbdb-211d-43e1-a024-b48a915f7fa7 Jul 08 01:02:55 devstack sudo[91001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:02:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-bde0594e-4fbe-4c69-a7a5-e7a82bda4f9a tempest-VolumesActionsTest-345274021 None] Acquiring lock "cinder-683e5d08-2987-457a-9dd7-207967f5981e-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:02:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-bde0594e-4fbe-4c69-a7a5-e7a82bda4f9a tempest-VolumesActionsTest-345274021 None] Lock "cinder-683e5d08-2987-457a-9dd7-207967f5981e-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:02:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-bde0594e-4fbe-4c69-a7a5-e7a82bda4f9a tempest-VolumesActionsTest-345274021 None] Acquiring lock "cinder-quobyte-683e5d08-2987-457a-9dd7-207967f5981e" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:02:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-bde0594e-4fbe-4c69-a7a5-e7a82bda4f9a tempest-VolumesActionsTest-345274021 None] Lock "cinder-quobyte-683e5d08-2987-457a-9dd7-207967f5981e" acquired by "delete_volume" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:02:56 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d73b49-671b-4156-9358-58c7b4d29e89]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:02:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bde0594e-4fbe-4c69-a7a5-e7a82bda4f9a tempest-VolumesActionsTest-345274021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-683e5d08-2987-457a-9dd7-207967f5981e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:02:56 devstack sudo[91001]: pam_unix(sudo:session): session closed for user root Jul 08 01:02:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-06aca908-9a04-42c9-9f2a-b9f961511f4e req-2c7eb2d0-85be-42c0-99f7-f8f8ba72f1f7 tempest-ServerActionsTestOtherA-2051284359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-987ecbdb-211d-43e1-a024-b48a915f7fa7" returned: 0 in 1.024s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:02:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-06aca908-9a04-42c9-9f2a-b9f961511f4e req-2c7eb2d0-85be-42c0-99f7-f8f8ba72f1f7 tempest-ServerActionsTestOtherA-2051284359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.062s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:02:56 devstack sudo[91006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-683e5d08-2987-457a-9dd7-207967f5981e Jul 08 01:02:56 devstack sudo[91006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:02:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-06aca908-9a04-42c9-9f2a-b9f961511f4e req-2c7eb2d0-85be-42c0-99f7-f8f8ba72f1f7 tempest-ServerActionsTestOtherA-2051284359 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e', 'name': 'volume-987ecbdb-211d-43e1-a024-b48a915f7fa7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a45be9b7-fc00-4113-bba8-faf231c0feea', 'enforce_multipath': True} {{(pid=87123) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:02:56 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-06aca908-9a04-42c9-9f2a-b9f961511f4e req-2c7eb2d0-85be-42c0-99f7-f8f8ba72f1f7 tempest-ServerActionsTestOtherA-2051284359 None] attachment_update completed successfully. Jul 08 01:02:57 devstack sudo[91006]: pam_unix(sudo:session): session closed for user root Jul 08 01:02:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bde0594e-4fbe-4c69-a7a5-e7a82bda4f9a tempest-VolumesActionsTest-345274021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-683e5d08-2987-457a-9dd7-207967f5981e" returned: 0 in 1.141s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:02:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bde0594e-4fbe-4c69-a7a5-e7a82bda4f9a tempest-VolumesActionsTest-345274021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-683e5d08-2987-457a-9dd7-207967f5981e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:02:57 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-683e5d08-2987-457a-9dd7-207967f5981e Jul 08 01:02:57 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:02:57 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Jul 08 01:02:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bde0594e-4fbe-4c69-a7a5-e7a82bda4f9a tempest-VolumesActionsTest-345274021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-683e5d08-2987-457a-9dd7-207967f5981e" returned: 0 in 0.688s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:02:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-bde0594e-4fbe-4c69-a7a5-e7a82bda4f9a tempest-VolumesActionsTest-345274021 None] Lock "cinder-quobyte-683e5d08-2987-457a-9dd7-207967f5981e" released by "delete_volume" :: held 1.884s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:02:58 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-bde0594e-4fbe-4c69-a7a5-e7a82bda4f9a tempest-VolumesActionsTest-345274021 None] Created reservations ['c4d3d31b-7c47-4aa7-b612-97435202b445', '48a4b667-a8bb-4ee4-803b-91471985e96c', 'c96bf633-8a96-4cfe-9418-2e6980bb52c6', '10a78a63-3f13-4dd9-98a6-e0107f2b7e1f'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:02:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bde0594e-4fbe-4c69-a7a5-e7a82bda4f9a tempest-VolumesActionsTest-345274021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:02:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bde0594e-4fbe-4c69-a7a5-e7a82bda4f9a tempest-VolumesActionsTest-345274021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:02:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bde0594e-4fbe-4c69-a7a5-e7a82bda4f9a tempest-VolumesActionsTest-345274021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:02:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bde0594e-4fbe-4c69-a7a5-e7a82bda4f9a tempest-VolumesActionsTest-345274021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:02:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bde0594e-4fbe-4c69-a7a5-e7a82bda4f9a tempest-VolumesActionsTest-345274021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:02:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bde0594e-4fbe-4c69-a7a5-e7a82bda4f9a tempest-VolumesActionsTest-345274021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:02:58 devstack sudo[91396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:02:58 devstack sudo[91396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:02:59 devstack sudo[91396]: pam_unix(sudo:session): session closed for user root Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bde0594e-4fbe-4c69-a7a5-e7a82bda4f9a tempest-VolumesActionsTest-345274021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.838s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-bde0594e-4fbe-4c69-a7a5-e7a82bda4f9a tempest-VolumesActionsTest-345274021 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:02:59 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-bde0594e-4fbe-4c69-a7a5-e7a82bda4f9a tempest-VolumesActionsTest-345274021 None] Deleted volume successfully. Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-bde0594e-4fbe-4c69-a7a5-e7a82bda4f9a tempest-VolumesActionsTest-345274021 None] Lock "cinder-683e5d08-2987-457a-9dd7-207967f5981e-delete_volume" released by "delete_volume" :: held 3.098s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Flow 'volume_create_manager' (83bd1b75-713c-4cbb-b72e-f55773c2e6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2f4ca1-2d73-420c-97e2-605c76310581) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e2f4ca1-2d73-420c-97e2-605c76310581) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1684639864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c81eede-3057-4a35-ac98-5ee040257a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394c75e7409d4b23a5f4ecbf7c46deb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:02:59Z,use_quota=True,user_id='a821541c7f194fd4acb41674ec7b6b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e936552-f166-4c08-9c37-23596eee9398) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e936552-f166-4c08-9c37-23596eee9398) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a6423a-793a-4a51-beb6-3e347e1f2f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08a6423a-793a-4a51-beb6-3e347e1f2f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c81eede-3057-4a35-ac98-5ee040257a10', 'volume_name': 'volume-6c81eede-3057-4a35-ac98-5ee040257a10', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c998a764-856c-46b1-a843-ca93e485cb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c998a764-856c-46b1-a843-ca93e485cb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16fd7ff-0f57-414b-8be3-46da9e94ddaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:02:59 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Volume 6c81eede-3057-4a35-ac98-5ee040257a10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c81eede-3057-4a35-ac98-5ee040257a10', 'volume_size': 1} Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:02:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1684639864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c81eede-3057-4a35-ac98-5ee040257a10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394c75e7409d4b23a5f4ecbf7c46deb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:02:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:02:59Z,use_quota=True,user_id='a821541c7f194fd4acb41674ec7b6b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Creating volume 6c81eede-3057-4a35-ac98-5ee040257a10 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:02:59 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:02:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6c81eede-3057-4a35-ac98-5ee040257a10 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:02:59 devstack sudo[91399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6c81eede-3057-4a35-ac98-5ee040257a10 1073741824 Jul 08 01:02:59 devstack sudo[91399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:00 devstack sudo[91399]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6c81eede-3057-4a35-ac98-5ee040257a10 1073741824" returned: 0 in 1.175s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6c81eede-3057-4a35-ac98-5ee040257a10 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:00 devstack sudo[91407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6c81eede-3057-4a35-ac98-5ee040257a10 Jul 08 01:03:00 devstack sudo[91407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:01 devstack sudo[91407]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6c81eede-3057-4a35-ac98-5ee040257a10" returned: 0 in 1.091s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] <== create_volume: return (2331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:03:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.335s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d16fd7ff-0f57-414b-8be3-46da9e94ddaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c81eede-3057-4a35-ac98-5ee040257a10', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2faf88c0-b19e-424d-aebe-6c20ef9b0ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:01 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Volume volume-6c81eede-3057-4a35-ac98-5ee040257a10 (6c81eede-3057-4a35-ac98-5ee040257a10): created successfully Jul 08 01:03:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2faf88c0-b19e-424d-aebe-6c20ef9b0ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Flow 'volume_create_manager' (83bd1b75-713c-4cbb-b72e-f55773c2e6fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:03:01 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-97376206-1f96-492b-98bd-5597235146da tempest-VolumesActionsTest-680111013 None] Created volume successfully. Jul 08 01:03:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-34acae08-b4d5-4de6-85fd-7da21fda2440 tempest-VolumesActionsTest-345274021 None] Acquiring lock "cinder-6c81eede-3057-4a35-ac98-5ee040257a10-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:03:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-34acae08-b4d5-4de6-85fd-7da21fda2440 tempest-VolumesActionsTest-345274021 None] Lock "cinder-6c81eede-3057-4a35-ac98-5ee040257a10-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:03:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-34acae08-b4d5-4de6-85fd-7da21fda2440 tempest-VolumesActionsTest-345274021 None] Acquiring lock "cinder-quobyte-6c81eede-3057-4a35-ac98-5ee040257a10" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:03:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-34acae08-b4d5-4de6-85fd-7da21fda2440 tempest-VolumesActionsTest-345274021 None] Lock "cinder-quobyte-6c81eede-3057-4a35-ac98-5ee040257a10" acquired by "delete_volume" :: waited 0.051s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:03:03 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8e2089-3b0a-46d1-ac07-cefa490997b2]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:03:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-34acae08-b4d5-4de6-85fd-7da21fda2440 tempest-VolumesActionsTest-345274021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6c81eede-3057-4a35-ac98-5ee040257a10 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:03 devstack sudo[91456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6c81eede-3057-4a35-ac98-5ee040257a10 Jul 08 01:03:03 devstack sudo[91456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:04 devstack sudo[91456]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-34acae08-b4d5-4de6-85fd-7da21fda2440 tempest-VolumesActionsTest-345274021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6c81eede-3057-4a35-ac98-5ee040257a10" returned: 0 in 0.913s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-34acae08-b4d5-4de6-85fd-7da21fda2440 tempest-VolumesActionsTest-345274021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6c81eede-3057-4a35-ac98-5ee040257a10 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:04 devstack sudo[91462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6c81eede-3057-4a35-ac98-5ee040257a10 Jul 08 01:03:04 devstack sudo[91462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:05 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-644b9f91-b709-40aa-b007-54edd7a1e760 req-5e96fba4-8e4f-4b2c-8f80-33b9578f66f7 tempest-ServerActionsTestOtherA-2051284359 None] Terminate volume connection completed successfully. Jul 08 01:03:05 devstack sudo[91462]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-644b9f91-b709-40aa-b007-54edd7a1e760 req-5e96fba4-8e4f-4b2c-8f80-33b9578f66f7 tempest-ServerActionsTestOtherA-2051284359 None] Deleting attachment a45be9b7-fc00-4113-bba8-faf231c0feea. {{(pid=87123) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:03:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-34acae08-b4d5-4de6-85fd-7da21fda2440 tempest-VolumesActionsTest-345274021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6c81eede-3057-4a35-ac98-5ee040257a10" returned: 0 in 0.979s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:05 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-34acae08-b4d5-4de6-85fd-7da21fda2440 tempest-VolumesActionsTest-345274021 None] Lock "cinder-quobyte-6c81eede-3057-4a35-ac98-5ee040257a10" released by "delete_volume" :: held 2.008s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:03:05 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-34acae08-b4d5-4de6-85fd-7da21fda2440 tempest-VolumesActionsTest-345274021 None] Created reservations ['36f0cb94-c8a8-46c5-bb1f-7c70d032a3a2', '208bf282-2e4d-4115-a229-057f83b759ab', '397a64b3-048a-4c52-b8e7-0a68cd2f9db8', 'dc6a6cfc-d71b-4163-ba12-39294e921309'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:03:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-34acae08-b4d5-4de6-85fd-7da21fda2440 tempest-VolumesActionsTest-345274021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-34acae08-b4d5-4de6-85fd-7da21fda2440 tempest-VolumesActionsTest-345274021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:05 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-34acae08-b4d5-4de6-85fd-7da21fda2440 tempest-VolumesActionsTest-345274021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:03:05 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-34acae08-b4d5-4de6-85fd-7da21fda2440 tempest-VolumesActionsTest-345274021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:03:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-34acae08-b4d5-4de6-85fd-7da21fda2440 tempest-VolumesActionsTest-345274021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-34acae08-b4d5-4de6-85fd-7da21fda2440 tempest-VolumesActionsTest-345274021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:05 devstack sudo[91499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:03:05 devstack sudo[91499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Flow 'volume_create_manager' (a4dab60f-c4f9-4d9a-9061-c49947386f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e457dd9-cd8c-4912-93fe-6733a481b430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e457dd9-cd8c-4912-93fe-6733a481b430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-75547930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da45d990-ed62-46e6-aaf5-cfff60ff7091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394c75e7409d4b23a5f4ecbf7c46deb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:03:06Z,use_quota=True,user_id='a821541c7f194fd4acb41674ec7b6b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8737de-16bc-47ee-9b34-09f90733130e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b8737de-16bc-47ee-9b34-09f90733130e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faed8b5f-9824-4a4f-8c7c-c5ad457ab9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (faed8b5f-9824-4a4f-8c7c-c5ad457ab9b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da45d990-ed62-46e6-aaf5-cfff60ff7091', 'volume_name': 'volume-da45d990-ed62-46e6-aaf5-cfff60ff7091', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887d3a7c-32b7-42cd-8383-8e5f1e0fa660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (887d3a7c-32b7-42cd-8383-8e5f1e0fa660) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e4dc45e-70b3-4ca7-9847-6bde83f6bdbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:06 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Volume da45d990-ed62-46e6-aaf5-cfff60ff7091: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da45d990-ed62-46e6-aaf5-cfff60ff7091', 'volume_size': 1} Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-75547930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da45d990-ed62-46e6-aaf5-cfff60ff7091,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394c75e7409d4b23a5f4ecbf7c46deb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:03:06Z,use_quota=True,user_id='a821541c7f194fd4acb41674ec7b6b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Creating volume da45d990-ed62-46e6-aaf5-cfff60ff7091 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:03:06 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-da45d990-ed62-46e6-aaf5-cfff60ff7091 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:06 devstack sudo[91499]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-34acae08-b4d5-4de6-85fd-7da21fda2440 tempest-VolumesActionsTest-345274021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.110s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-34acae08-b4d5-4de6-85fd-7da21fda2440 tempest-VolumesActionsTest-345274021 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:03:06 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-34acae08-b4d5-4de6-85fd-7da21fda2440 tempest-VolumesActionsTest-345274021 None] Deleted volume successfully. Jul 08 01:03:06 devstack sudo[91545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-da45d990-ed62-46e6-aaf5-cfff60ff7091 1073741824 Jul 08 01:03:06 devstack sudo[91545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:06 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-34acae08-b4d5-4de6-85fd-7da21fda2440 tempest-VolumesActionsTest-345274021 None] Lock "cinder-6c81eede-3057-4a35-ac98-5ee040257a10-delete_volume" released by "delete_volume" :: held 3.601s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:03:07 devstack sudo[91545]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-da45d990-ed62-46e6-aaf5-cfff60ff7091 1073741824" returned: 0 in 1.326s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-da45d990-ed62-46e6-aaf5-cfff60ff7091 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-644b9f91-b709-40aa-b007-54edd7a1e760 req-1578229e-3e11-4009-9ef5-3eeed9451301 tempest-ServerActionsTestOtherA-2051284359 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:07 devstack sudo[91571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-da45d990-ed62-46e6-aaf5-cfff60ff7091 Jul 08 01:03:07 devstack sudo[91571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:08 devstack sudo[91571]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-da45d990-ed62-46e6-aaf5-cfff60ff7091" returned: 0 in 0.710s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:08 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:03:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-644b9f91-b709-40aa-b007-54edd7a1e760 req-1578229e-3e11-4009-9ef5-3eeed9451301 tempest-ServerActionsTestOtherA-2051284359 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.698s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e4dc45e-70b3-4ca7-9847-6bde83f6bdbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da45d990-ed62-46e6-aaf5-cfff60ff7091', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e38f9c-805b-41e5-baee-d2d8fa579481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:08 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3136ba6-9dfa-4236-a7f9-1a1f3b4d273f]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:03:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-644b9f91-b709-40aa-b007-54edd7a1e760 req-1578229e-3e11-4009-9ef5-3eeed9451301 tempest-ServerActionsTestOtherA-2051284359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-987ecbdb-211d-43e1-a024-b48a915f7fa7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:08 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Volume volume-da45d990-ed62-46e6-aaf5-cfff60ff7091 (da45d990-ed62-46e6-aaf5-cfff60ff7091): created successfully Jul 08 01:03:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e38f9c-805b-41e5-baee-d2d8fa579481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Flow 'volume_create_manager' (a4dab60f-c4f9-4d9a-9061-c49947386f7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:03:08 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-9c9635c9-af16-45d0-a571-5506564eb702 tempest-VolumesActionsTest-680111013 None] Created volume successfully. Jul 08 01:03:08 devstack sudo[91574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-987ecbdb-211d-43e1-a024-b48a915f7fa7 Jul 08 01:03:08 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:09 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-644b9f91-b709-40aa-b007-54edd7a1e760 req-1578229e-3e11-4009-9ef5-3eeed9451301 tempest-ServerActionsTestOtherA-2051284359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-987ecbdb-211d-43e1-a024-b48a915f7fa7" returned: 0 in 0.911s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-644b9f91-b709-40aa-b007-54edd7a1e760 req-1578229e-3e11-4009-9ef5-3eeed9451301 tempest-ServerActionsTestOtherA-2051284359 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.950s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-644b9f91-b709-40aa-b007-54edd7a1e760 req-1578229e-3e11-4009-9ef5-3eeed9451301 tempest-ServerActionsTestOtherA-2051284359 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e', 'name': 'volume-987ecbdb-211d-43e1-a024-b48a915f7fa7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f84dcf0e-fffb-4961-b30f-a4c8ae6c536a', 'enforce_multipath': True} {{(pid=87123) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:03:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d4ba8c54-7906-48c1-9bff-933c9f1a0d7c tempest-VolumesActionsTest-345274021 None] Acquiring lock "cinder-da45d990-ed62-46e6-aaf5-cfff60ff7091-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:03:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d4ba8c54-7906-48c1-9bff-933c9f1a0d7c tempest-VolumesActionsTest-345274021 None] Lock "cinder-da45d990-ed62-46e6-aaf5-cfff60ff7091-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:03:09 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-644b9f91-b709-40aa-b007-54edd7a1e760 req-1578229e-3e11-4009-9ef5-3eeed9451301 tempest-ServerActionsTestOtherA-2051284359 None] attachment_update completed successfully. Jul 08 01:03:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d4ba8c54-7906-48c1-9bff-933c9f1a0d7c tempest-VolumesActionsTest-345274021 None] Acquiring lock "cinder-quobyte-da45d990-ed62-46e6-aaf5-cfff60ff7091" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:03:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d4ba8c54-7906-48c1-9bff-933c9f1a0d7c tempest-VolumesActionsTest-345274021 None] Lock "cinder-quobyte-da45d990-ed62-46e6-aaf5-cfff60ff7091" acquired by "delete_volume" :: waited 0.022s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:03:09 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcf83b1-8cec-45a8-aad5-414cd8f2625e]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:03:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d4ba8c54-7906-48c1-9bff-933c9f1a0d7c tempest-VolumesActionsTest-345274021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-da45d990-ed62-46e6-aaf5-cfff60ff7091 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:10 devstack sudo[91581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-da45d990-ed62-46e6-aaf5-cfff60ff7091 Jul 08 01:03:10 devstack sudo[91581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1b4cede0-68d6-46e6-95a5-1e1f432d845c tempest-AttachVolumeShelveTestJSON-1398869319 None] Acquiring lock "cinder-ae6d8329-5a71-4882-a299-9705b1410253-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:03:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1b4cede0-68d6-46e6-95a5-1e1f432d845c tempest-AttachVolumeShelveTestJSON-1398869319 None] Lock "cinder-ae6d8329-5a71-4882-a299-9705b1410253-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:03:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1b4cede0-68d6-46e6-95a5-1e1f432d845c tempest-AttachVolumeShelveTestJSON-1398869319 None] Acquiring lock "cinder-quobyte-ae6d8329-5a71-4882-a299-9705b1410253" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:03:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1b4cede0-68d6-46e6-95a5-1e1f432d845c tempest-AttachVolumeShelveTestJSON-1398869319 None] Lock "cinder-quobyte-ae6d8329-5a71-4882-a299-9705b1410253" acquired by "delete_volume" :: waited 0.027s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:03:10 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[941f948a-63fb-4740-95e9-8fdf7cee1b9b]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:03:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1b4cede0-68d6-46e6-95a5-1e1f432d845c tempest-AttachVolumeShelveTestJSON-1398869319 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ae6d8329-5a71-4882-a299-9705b1410253 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:10 devstack sudo[91583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ae6d8329-5a71-4882-a299-9705b1410253 Jul 08 01:03:10 devstack sudo[91583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:10 devstack sudo[91581]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d4ba8c54-7906-48c1-9bff-933c9f1a0d7c tempest-VolumesActionsTest-345274021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-da45d990-ed62-46e6-aaf5-cfff60ff7091" returned: 0 in 1.047s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d4ba8c54-7906-48c1-9bff-933c9f1a0d7c tempest-VolumesActionsTest-345274021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-da45d990-ed62-46e6-aaf5-cfff60ff7091 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:10 devstack sudo[91588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-da45d990-ed62-46e6-aaf5-cfff60ff7091 Jul 08 01:03:10 devstack sudo[91588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:11 devstack sudo[91588]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d4ba8c54-7906-48c1-9bff-933c9f1a0d7c tempest-VolumesActionsTest-345274021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-da45d990-ed62-46e6-aaf5-cfff60ff7091" returned: 0 in 0.753s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:11 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d4ba8c54-7906-48c1-9bff-933c9f1a0d7c tempest-VolumesActionsTest-345274021 None] Lock "cinder-quobyte-da45d990-ed62-46e6-aaf5-cfff60ff7091" released by "delete_volume" :: held 1.859s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:03:11 devstack sudo[91583]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:11 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-d4ba8c54-7906-48c1-9bff-933c9f1a0d7c tempest-VolumesActionsTest-345274021 None] Created reservations ['00c40800-a1a6-4e9f-95df-b468b767c238', 'be2c58b9-d9b9-498e-9d19-d2eee081c1c0', 'e6970141-074f-4c51-b183-d98953974fc5', '70d90f66-d874-4938-a02d-2c106d759024'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:03:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1b4cede0-68d6-46e6-95a5-1e1f432d845c tempest-AttachVolumeShelveTestJSON-1398869319 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ae6d8329-5a71-4882-a299-9705b1410253" returned: 0 in 1.080s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1b4cede0-68d6-46e6-95a5-1e1f432d845c tempest-AttachVolumeShelveTestJSON-1398869319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ae6d8329-5a71-4882-a299-9705b1410253 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:11 devstack sudo[91595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ae6d8329-5a71-4882-a299-9705b1410253 Jul 08 01:03:11 devstack sudo[91595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d4ba8c54-7906-48c1-9bff-933c9f1a0d7c tempest-VolumesActionsTest-345274021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d4ba8c54-7906-48c1-9bff-933c9f1a0d7c tempest-VolumesActionsTest-345274021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d4ba8c54-7906-48c1-9bff-933c9f1a0d7c tempest-VolumesActionsTest-345274021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:03:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d4ba8c54-7906-48c1-9bff-933c9f1a0d7c tempest-VolumesActionsTest-345274021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:03:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d4ba8c54-7906-48c1-9bff-933c9f1a0d7c tempest-VolumesActionsTest-345274021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d4ba8c54-7906-48c1-9bff-933c9f1a0d7c tempest-VolumesActionsTest-345274021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:11 devstack sudo[91600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:03:11 devstack sudo[91600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Flow 'volume_create_manager' (81d19569-12be-4244-804b-8ae09f53ff57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b388d08a-4730-440e-8b63-9d780cdb7fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b388d08a-4730-440e-8b63-9d780cdb7fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1418800953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fdb6a15-284d-4f69-9162-19a280dc909f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394c75e7409d4b23a5f4ecbf7c46deb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:03:13Z,use_quota=True,user_id='a821541c7f194fd4acb41674ec7b6b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5253f520-9879-486d-8b45-ef1495e2a8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5253f520-9879-486d-8b45-ef1495e2a8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a305e7-9e7e-42d4-b6dd-e95b940701c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9a305e7-9e7e-42d4-b6dd-e95b940701c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fdb6a15-284d-4f69-9162-19a280dc909f', 'volume_name': 'volume-0fdb6a15-284d-4f69-9162-19a280dc909f', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639a501a-eb29-4e29-8a54-b726df5c12f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (639a501a-eb29-4e29-8a54-b726df5c12f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de120670-1ec8-46f9-b88f-6d3645aa701c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:12 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Volume 0fdb6a15-284d-4f69-9162-19a280dc909f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fdb6a15-284d-4f69-9162-19a280dc909f', 'volume_size': 1} Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:03:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1418800953',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fdb6a15-284d-4f69-9162-19a280dc909f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394c75e7409d4b23a5f4ecbf7c46deb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:03:13Z,use_quota=True,user_id='a821541c7f194fd4acb41674ec7b6b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Creating volume 0fdb6a15-284d-4f69-9162-19a280dc909f {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:03:12 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0fdb6a15-284d-4f69-9162-19a280dc909f 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:12 devstack sudo[91621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0fdb6a15-284d-4f69-9162-19a280dc909f 1073741824 Jul 08 01:03:12 devstack sudo[91621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:12 devstack sudo[91595]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1b4cede0-68d6-46e6-95a5-1e1f432d845c tempest-AttachVolumeShelveTestJSON-1398869319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ae6d8329-5a71-4882-a299-9705b1410253" returned: 0 in 1.205s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:12 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1b4cede0-68d6-46e6-95a5-1e1f432d845c tempest-AttachVolumeShelveTestJSON-1398869319 None] Lock "cinder-quobyte-ae6d8329-5a71-4882-a299-9705b1410253" released by "delete_volume" :: held 2.336s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:03:13 devstack sudo[91600]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d4ba8c54-7906-48c1-9bff-933c9f1a0d7c tempest-VolumesActionsTest-345274021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.103s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:13 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-d4ba8c54-7906-48c1-9bff-933c9f1a0d7c tempest-VolumesActionsTest-345274021 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:03:13 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-d4ba8c54-7906-48c1-9bff-933c9f1a0d7c tempest-VolumesActionsTest-345274021 None] Deleted volume successfully. Jul 08 01:03:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d4ba8c54-7906-48c1-9bff-933c9f1a0d7c tempest-VolumesActionsTest-345274021 None] Lock "cinder-da45d990-ed62-46e6-aaf5-cfff60ff7091-delete_volume" released by "delete_volume" :: held 3.297s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:03:13 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-1b4cede0-68d6-46e6-95a5-1e1f432d845c tempest-AttachVolumeShelveTestJSON-1398869319 None] Created reservations ['dd331493-496a-4f87-a202-98867cf5cfb5', 'f2eaf3a8-8a69-4920-9c99-6a8aa70991d4', 'a658fd94-4be0-4cf8-9a1c-0b993060ff57', '85ae477b-0af3-447b-95ba-107725f08704'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:03:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1b4cede0-68d6-46e6-95a5-1e1f432d845c tempest-AttachVolumeShelveTestJSON-1398869319 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1b4cede0-68d6-46e6-95a5-1e1f432d845c tempest-AttachVolumeShelveTestJSON-1398869319 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1b4cede0-68d6-46e6-95a5-1e1f432d845c tempest-AttachVolumeShelveTestJSON-1398869319 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:03:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1b4cede0-68d6-46e6-95a5-1e1f432d845c tempest-AttachVolumeShelveTestJSON-1398869319 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:03:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1b4cede0-68d6-46e6-95a5-1e1f432d845c tempest-AttachVolumeShelveTestJSON-1398869319 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1b4cede0-68d6-46e6-95a5-1e1f432d845c tempest-AttachVolumeShelveTestJSON-1398869319 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:13 devstack sudo[91688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:03:13 devstack sudo[91688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:13 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:03:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Flow 'volume_create_manager' (f5528e43-3222-4e79-90c2-ebc9c61bd12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:03:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f7702d-99e2-4ca5-955f-7e9227e9b255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07f7702d-99e2-4ca5-955f-7e9227e9b255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2047480671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db0da99f-59f5-41d7-a017-a66ae4eaf5db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd8b0494e0f49588b32ce1d5a18ef2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:03:13Z,use_quota=True,user_id='83da6367b17d42788b2ce052d834054a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a158375-34b4-49ff-b573-564601ea7adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a158375-34b4-49ff-b573-564601ea7adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83eedc35-4943-4bea-821f-c9ed3b79c99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83eedc35-4943-4bea-821f-c9ed3b79c99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db0da99f-59f5-41d7-a017-a66ae4eaf5db', 'volume_name': 'volume-db0da99f-59f5-41d7-a017-a66ae4eaf5db', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6caba34d-8a2b-4997-8696-02af3c63a0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6caba34d-8a2b-4997-8696-02af3c63a0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8ccc8e-3e4d-4208-88a3-52915ed96f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:13 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Volume db0da99f-59f5-41d7-a017-a66ae4eaf5db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db0da99f-59f5-41d7-a017-a66ae4eaf5db', 'volume_size': 1} Jul 08 01:03:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:14 devstack sudo[91621]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0fdb6a15-284d-4f69-9162-19a280dc909f 1073741824" returned: 0 in 1.186s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0fdb6a15-284d-4f69-9162-19a280dc909f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:14 devstack sudo[91710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0fdb6a15-284d-4f69-9162-19a280dc909f Jul 08 01:03:14 devstack sudo[91710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:14 devstack sudo[91688]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1b4cede0-68d6-46e6-95a5-1e1f432d845c tempest-AttachVolumeShelveTestJSON-1398869319 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.030s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:14 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-1b4cede0-68d6-46e6-95a5-1e1f432d845c tempest-AttachVolumeShelveTestJSON-1398869319 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:03:14 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-1b4cede0-68d6-46e6-95a5-1e1f432d845c tempest-AttachVolumeShelveTestJSON-1398869319 None] Deleted volume successfully. Jul 08 01:03:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1b4cede0-68d6-46e6-95a5-1e1f432d845c tempest-AttachVolumeShelveTestJSON-1398869319 None] Lock "cinder-ae6d8329-5a71-4882-a299-9705b1410253-delete_volume" released by "delete_volume" :: held 3.755s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:03:15 devstack sudo[91710]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0fdb6a15-284d-4f69-9162-19a280dc909f" returned: 0 in 0.894s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] <== create_volume: return (2158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:03:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.161s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.593s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:03:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2047480671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db0da99f-59f5-41d7-a017-a66ae4eaf5db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd8b0494e0f49588b32ce1d5a18ef2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:03:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:03:13Z,use_quota=True,user_id='83da6367b17d42788b2ce052d834054a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:03:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Creating volume db0da99f-59f5-41d7-a017-a66ae4eaf5db {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:03:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:03:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:03:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:03:15 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:03:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-db0da99f-59f5-41d7-a017-a66ae4eaf5db 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:15 devstack sudo[91718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-db0da99f-59f5-41d7-a017-a66ae4eaf5db 1073741824 Jul 08 01:03:15 devstack sudo[91718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de120670-1ec8-46f9-b88f-6d3645aa701c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fdb6a15-284d-4f69-9162-19a280dc909f', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b72eb7-b0f6-45d8-853c-51effb3992ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:15 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Volume volume-0fdb6a15-284d-4f69-9162-19a280dc909f (0fdb6a15-284d-4f69-9162-19a280dc909f): created successfully Jul 08 01:03:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03b72eb7-b0f6-45d8-853c-51effb3992ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Flow 'volume_create_manager' (81d19569-12be-4244-804b-8ae09f53ff57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:03:15 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-36650788-0acf-4b89-be45-5a04444beca2 tempest-VolumesActionsTest-680111013 None] Created volume successfully. Jul 08 01:03:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9dcfe756-e511-4430-8c2f-cb595196ff4e tempest-VolumesActionsTest-345274021 None] Acquiring lock "cinder-0fdb6a15-284d-4f69-9162-19a280dc909f-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:03:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9dcfe756-e511-4430-8c2f-cb595196ff4e tempest-VolumesActionsTest-345274021 None] Lock "cinder-0fdb6a15-284d-4f69-9162-19a280dc909f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:03:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9dcfe756-e511-4430-8c2f-cb595196ff4e tempest-VolumesActionsTest-345274021 None] Acquiring lock "cinder-quobyte-0fdb6a15-284d-4f69-9162-19a280dc909f" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:03:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9dcfe756-e511-4430-8c2f-cb595196ff4e tempest-VolumesActionsTest-345274021 None] Lock "cinder-quobyte-0fdb6a15-284d-4f69-9162-19a280dc909f" acquired by "delete_volume" :: waited 0.028s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:03:16 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe1742a7-3960-4ac7-95c9-9e349a0210df]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:03:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9dcfe756-e511-4430-8c2f-cb595196ff4e tempest-VolumesActionsTest-345274021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0fdb6a15-284d-4f69-9162-19a280dc909f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:16 devstack sudo[91718]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-db0da99f-59f5-41d7-a017-a66ae4eaf5db 1073741824" returned: 0 in 1.416s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-db0da99f-59f5-41d7-a017-a66ae4eaf5db {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:16 devstack sudo[92061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-db0da99f-59f5-41d7-a017-a66ae4eaf5db Jul 08 01:03:16 devstack sudo[92061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:16 devstack sudo[92060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0fdb6a15-284d-4f69-9162-19a280dc909f Jul 08 01:03:16 devstack sudo[92060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:17 devstack sudo[92061]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-db0da99f-59f5-41d7-a017-a66ae4eaf5db" returned: 0 in 0.855s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] <== create_volume: return (2351ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:03:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.354s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b8ccc8e-3e4d-4208-88a3-52915ed96f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db0da99f-59f5-41d7-a017-a66ae4eaf5db', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e562708e-37bc-4486-b71b-f57ff4a38050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:17 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Volume volume-db0da99f-59f5-41d7-a017-a66ae4eaf5db (db0da99f-59f5-41d7-a017-a66ae4eaf5db): created successfully Jul 08 01:03:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e562708e-37bc-4486-b71b-f57ff4a38050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Flow 'volume_create_manager' (f5528e43-3222-4e79-90c2-ebc9c61bd12d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:03:17 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-73d6ee92-16a6-43a7-a0fa-8bd5391fa457 tempest-AttachVolumeNegativeTest-1707411501 None] Created volume successfully. Jul 08 01:03:17 devstack sudo[92060]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9dcfe756-e511-4430-8c2f-cb595196ff4e tempest-VolumesActionsTest-345274021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0fdb6a15-284d-4f69-9162-19a280dc909f" returned: 0 in 1.255s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9dcfe756-e511-4430-8c2f-cb595196ff4e tempest-VolumesActionsTest-345274021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0fdb6a15-284d-4f69-9162-19a280dc909f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:17 devstack sudo[92072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0fdb6a15-284d-4f69-9162-19a280dc909f Jul 08 01:03:17 devstack sudo[92072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:18 devstack sudo[92072]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9dcfe756-e511-4430-8c2f-cb595196ff4e tempest-VolumesActionsTest-345274021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0fdb6a15-284d-4f69-9162-19a280dc909f" returned: 0 in 1.054s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:18 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9dcfe756-e511-4430-8c2f-cb595196ff4e tempest-VolumesActionsTest-345274021 None] Lock "cinder-quobyte-0fdb6a15-284d-4f69-9162-19a280dc909f" released by "delete_volume" :: held 2.388s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:03:18 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-9dcfe756-e511-4430-8c2f-cb595196ff4e tempest-VolumesActionsTest-345274021 None] Created reservations ['0e01de1f-ad77-4619-9c42-3c319d9d3e1e', '14887698-3849-401b-8428-6b1a9a23c664', 'e1ca37c7-5ea3-4567-8def-44a324960e22', '32db4a61-f950-4dcb-adfb-eb4730077cd4'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:03:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9dcfe756-e511-4430-8c2f-cb595196ff4e tempest-VolumesActionsTest-345274021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9dcfe756-e511-4430-8c2f-cb595196ff4e tempest-VolumesActionsTest-345274021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9dcfe756-e511-4430-8c2f-cb595196ff4e tempest-VolumesActionsTest-345274021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:03:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9dcfe756-e511-4430-8c2f-cb595196ff4e tempest-VolumesActionsTest-345274021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:03:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9dcfe756-e511-4430-8c2f-cb595196ff4e tempest-VolumesActionsTest-345274021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9dcfe756-e511-4430-8c2f-cb595196ff4e tempest-VolumesActionsTest-345274021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:19 devstack sudo[92079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:03:19 devstack sudo[92079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:20 devstack sudo[92079]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9dcfe756-e511-4430-8c2f-cb595196ff4e tempest-VolumesActionsTest-345274021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.378s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:20 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-9dcfe756-e511-4430-8c2f-cb595196ff4e tempest-VolumesActionsTest-345274021 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:03:20 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-9dcfe756-e511-4430-8c2f-cb595196ff4e tempest-VolumesActionsTest-345274021 None] Deleted volume successfully. Jul 08 01:03:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9dcfe756-e511-4430-8c2f-cb595196ff4e tempest-VolumesActionsTest-345274021 None] Lock "cinder-0fdb6a15-284d-4f69-9162-19a280dc909f-delete_volume" released by "delete_volume" :: held 4.206s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:03:20 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:03:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Flow 'volume_create_manager' (40fd0ba1-991b-490c-9b42-8a3fa150ea79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:03:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb371fb-6480-4f46-8ff6-cbeeef63921b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (acb371fb-6480-4f46-8ff6-cbeeef63921b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-727750071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394c75e7409d4b23a5f4ecbf7c46deb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:03:21Z,use_quota=True,user_id='a821541c7f194fd4acb41674ec7b6b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edf23761-5191-4435-abc2-84c29b7c9519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edf23761-5191-4435-abc2-84c29b7c9519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5cfcad8-396d-4d3f-b442-60b42678bbbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5cfcad8-396d-4d3f-b442-60b42678bbbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e', 'volume_name': 'volume-259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147e0465-d1cd-4a22-bc77-2f1b6bd4de3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (147e0465-d1cd-4a22-bc77-2f1b6bd4de3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a68a7db3-0d81-45d8-96dd-59dd0d5ccb3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:21 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Volume 259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e', 'volume_size': 1} Jul 08 01:03:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:03:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-727750071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='394c75e7409d4b23a5f4ecbf7c46deb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:03:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:03:21Z,use_quota=True,user_id='a821541c7f194fd4acb41674ec7b6b6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:03:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Creating volume 259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:03:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:03:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:03:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:03:21 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:03:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:21 devstack sudo[92092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e 1073741824 Jul 08 01:03:21 devstack sudo[92092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-0edcfc8d-bbcc-49e0-a5e9-f5412b3a077a req-67675ac6-b7db-483a-be3e-bd70497f28ea tempest-AttachVolumeNegativeTest-1707411501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:22 devstack sudo[92092]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e 1073741824" returned: 0 in 1.132s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:22 devstack sudo[92105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e Jul 08 01:03:22 devstack sudo[92105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:23 devstack sudo[92105]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e" returned: 0 in 0.812s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] <== create_volume: return (2002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:03:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-0edcfc8d-bbcc-49e0-a5e9-f5412b3a077a req-67675ac6-b7db-483a-be3e-bd70497f28ea tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.663s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a68a7db3-0d81-45d8-96dd-59dd0d5ccb3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1707f0fb-1dd8-469d-a8d3-651a12b43591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:23 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73e2d64-0e18-400a-9085-b041a3ba1a27]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:03:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-0edcfc8d-bbcc-49e0-a5e9-f5412b3a077a req-67675ac6-b7db-483a-be3e-bd70497f28ea tempest-AttachVolumeNegativeTest-1707411501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-db0da99f-59f5-41d7-a017-a66ae4eaf5db {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:23 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Volume volume-259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e (259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e): created successfully Jul 08 01:03:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1707f0fb-1dd8-469d-a8d3-651a12b43591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Flow 'volume_create_manager' (40fd0ba1-991b-490c-9b42-8a3fa150ea79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:03:23 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-5d467ef0-7394-46f3-b03d-e5d47ee9a043 tempest-VolumesActionsTest-680111013 None] Created volume successfully. Jul 08 01:03:23 devstack sudo[92108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-db0da99f-59f5-41d7-a017-a66ae4eaf5db Jul 08 01:03:23 devstack sudo[92108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:24 devstack sudo[92108]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-0edcfc8d-bbcc-49e0-a5e9-f5412b3a077a req-67675ac6-b7db-483a-be3e-bd70497f28ea tempest-AttachVolumeNegativeTest-1707411501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-db0da99f-59f5-41d7-a017-a66ae4eaf5db" returned: 0 in 0.969s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-0edcfc8d-bbcc-49e0-a5e9-f5412b3a077a req-67675ac6-b7db-483a-be3e-bd70497f28ea tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.022s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-0edcfc8d-bbcc-49e0-a5e9-f5412b3a077a req-67675ac6-b7db-483a-be3e-bd70497f28ea tempest-AttachVolumeNegativeTest-1707411501 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e', 'name': 'volume-db0da99f-59f5-41d7-a017-a66ae4eaf5db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f400c114-e1e8-49db-a260-a613baae6dc3', 'enforce_multipath': True} {{(pid=87123) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:03:24 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-0edcfc8d-bbcc-49e0-a5e9-f5412b3a077a req-67675ac6-b7db-483a-be3e-bd70497f28ea tempest-AttachVolumeNegativeTest-1707411501 None] attachment_update completed successfully. Jul 08 01:03:24 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-465d4213-aca5-40e3-be13-6a96ad1b015e tempest-GroupSnapshotsTest-1813075391 None] Group tempest-GroupSnapshotsTest-Group-1516711052: creating Jul 08 01:03:24 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-465d4213-aca5-40e3-be13-6a96ad1b015e tempest-GroupSnapshotsTest-1813075391 None] Group tempest-GroupSnapshotsTest-Group-1516711052: created successfully Jul 08 01:03:24 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-465d4213-aca5-40e3-be13-6a96ad1b015e tempest-GroupSnapshotsTest-1813075391 None] Create group completed successfully. Jul 08 01:03:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66e14a01-d363-48c7-b334-f20f133257cf tempest-VolumesActionsTest-680111013 None] Acquiring lock "cinder-259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:03:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66e14a01-d363-48c7-b334-f20f133257cf tempest-VolumesActionsTest-680111013 None] Lock "cinder-259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:03:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66e14a01-d363-48c7-b334-f20f133257cf tempest-VolumesActionsTest-680111013 None] Acquiring lock "cinder-quobyte-259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:03:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66e14a01-d363-48c7-b334-f20f133257cf tempest-VolumesActionsTest-680111013 None] Lock "cinder-quobyte-259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e" acquired by "delete_volume" :: waited 0.025s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:03:25 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c70cbff-e152-4923-a74b-c8fbd5d5dc57]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:03:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66e14a01-d363-48c7-b334-f20f133257cf tempest-VolumesActionsTest-680111013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:25 devstack sudo[92116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e Jul 08 01:03:25 devstack sudo[92116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:26 devstack sudo[92116]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66e14a01-d363-48c7-b334-f20f133257cf tempest-VolumesActionsTest-680111013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e" returned: 0 in 0.891s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66e14a01-d363-48c7-b334-f20f133257cf tempest-VolumesActionsTest-680111013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:26 devstack sudo[92122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e Jul 08 01:03:26 devstack sudo[92122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Flow 'volume_create_manager' (1fe9b767-fa7e-40fd-aa24-586ed7a54307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec96b34e-8407-4910-b24e-683acae7a7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec96b34e-8407-4910-b24e-683acae7a7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1623449397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28b6620e-df70-4a07-b524-656cf8c24f61,host='devstack@QuobyteHD#QuobyteHD',id=51de83e4-9275-48a5-b1c6-bb6165fac502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735fa01232f0474fb478aed2dd8f744a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:03:27Z,use_quota=True,user_id='8a1f6bb8f1be45139832c6fd53993dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58d005fc-b677-4902-83b6-3c91bda307b5),volume_type_id=58d005fc-b677-4902-83b6-3c91bda307b5)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1896c0-82d4-45cb-a63d-4126c859a8fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1896c0-82d4-45cb-a63d-4126c859a8fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5907dbcf-e7ac-4e71-8606-e41a5a3c06df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5907dbcf-e7ac-4e71-8606-e41a5a3c06df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51de83e4-9275-48a5-b1c6-bb6165fac502', 'volume_name': 'volume-51de83e4-9275-48a5-b1c6-bb6165fac502', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fd3b75-1488-4188-92bf-f9c8f9720f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fd3b75-1488-4188-92bf-f9c8f9720f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:26 devstack sudo[92122]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa12a8c-9e8e-4d70-8f3f-f30445e6c402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:26 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Volume 51de83e4-9275-48a5-b1c6-bb6165fac502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51de83e4-9275-48a5-b1c6-bb6165fac502', 'volume_size': 1} Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=28b6620e-df70-4a07-b524-656cf8c24f61,created_at=2026-07-07T23:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1623449397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=28b6620e-df70-4a07-b524-656cf8c24f61,host='devstack@QuobyteHD#QuobyteHD',id=51de83e4-9275-48a5-b1c6-bb6165fac502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735fa01232f0474fb478aed2dd8f744a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:03:27Z,use_quota=True,user_id='8a1f6bb8f1be45139832c6fd53993dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(58d005fc-b677-4902-83b6-3c91bda307b5),volume_type_id=58d005fc-b677-4902-83b6-3c91bda307b5)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Creating volume 51de83e4-9275-48a5-b1c6-bb6165fac502 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:03:26 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66e14a01-d363-48c7-b334-f20f133257cf tempest-VolumesActionsTest-680111013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e" returned: 0 in 0.938s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66e14a01-d363-48c7-b334-f20f133257cf tempest-VolumesActionsTest-680111013 None] Lock "cinder-quobyte-259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e" released by "delete_volume" :: held 1.905s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:03:26 devstack sudo[92125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502 1073741824 Jul 08 01:03:26 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:27 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-66e14a01-d363-48c7-b334-f20f133257cf tempest-VolumesActionsTest-680111013 None] Created reservations ['72a24656-8bac-40aa-bc42-0108447e367b', '07335360-752e-4e81-ba90-c82329d3f561', '410160aa-f467-47bd-8d1a-09f3997bbd66', '0086170b-e7e2-4747-a4fe-17d628330aa6'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:03:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-66e14a01-d363-48c7-b334-f20f133257cf tempest-VolumesActionsTest-680111013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-66e14a01-d363-48c7-b334-f20f133257cf tempest-VolumesActionsTest-680111013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-66e14a01-d363-48c7-b334-f20f133257cf tempest-VolumesActionsTest-680111013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:03:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-66e14a01-d363-48c7-b334-f20f133257cf tempest-VolumesActionsTest-680111013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:03:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-66e14a01-d363-48c7-b334-f20f133257cf tempest-VolumesActionsTest-680111013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66e14a01-d363-48c7-b334-f20f133257cf tempest-VolumesActionsTest-680111013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:27 devstack sudo[92127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:03:27 devstack sudo[92127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:28 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502 1073741824" returned: 0 in 1.346s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:28 devstack sudo[92127]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66e14a01-d363-48c7-b334-f20f133257cf tempest-VolumesActionsTest-680111013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.193s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:28 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-66e14a01-d363-48c7-b334-f20f133257cf tempest-VolumesActionsTest-680111013 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:03:28 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-66e14a01-d363-48c7-b334-f20f133257cf tempest-VolumesActionsTest-680111013 None] Deleted volume successfully. Jul 08 01:03:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66e14a01-d363-48c7-b334-f20f133257cf tempest-VolumesActionsTest-680111013 None] Lock "cinder-259fcfe6-b6bc-40e9-b898-b0c53c6c1d6e-delete_volume" released by "delete_volume" :: held 3.414s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:03:28 devstack sudo[92135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502 Jul 08 01:03:28 devstack sudo[92135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:29 devstack sudo[92135]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502" returned: 0 in 1.220s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:29 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] <== create_volume: return (2665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:03:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.668s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:29 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aa12a8c-9e8e-4d70-8f3f-f30445e6c402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51de83e4-9275-48a5-b1c6-bb6165fac502', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:29 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c065d510-1d74-461e-8ecb-b7b86d4972c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:03:29 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Volume volume-51de83e4-9275-48a5-b1c6-bb6165fac502 (51de83e4-9275-48a5-b1c6-bb6165fac502): created successfully Jul 08 01:03:29 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c065d510-1d74-461e-8ecb-b7b86d4972c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:03:29 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Flow 'volume_create_manager' (1fe9b767-fa7e-40fd-aa24-586ed7a54307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:03:29 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b4b9f978-0bdb-4e0e-9943-6324d02dff7e tempest-GroupSnapshotsTest-1813075391 None] Created volume successfully. Jul 08 01:03:31 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-d3c4a72e-9f28-4cc8-8122-4baea2223d12 tempest-GroupSnapshotsTest-1813075391 None] GroupSnapshot 28b9602d-2d55-42ca-b7be-58e43fb71fe6: creating. Jul 08 01:03:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d3c4a72e-9f28-4cc8-8122-4baea2223d12 tempest-GroupSnapshotsTest-1813075391 None] Group snapshot 28b9602d-2d55-42ca-b7be-58e43fb71fe6: creating. {{(pid=87123) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 01:03:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d3c4a72e-9f28-4cc8-8122-4baea2223d12 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d3c4a72e-9f28-4cc8-8122-4baea2223d12 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-d3c4a72e-9f28-4cc8-8122-4baea2223d12 tempest-GroupSnapshotsTest-1813075391 None] Creating offline snapshot a34f9270-561d-4f93-8f9e-64df7e4f9ed2 of volume 51de83e4-9275-48a5-b1c6-bb6165fac502 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:03:31 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[433e298a-f9f0-4857-8036-d77bfc45a74c]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:03:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d3c4a72e-9f28-4cc8-8122-4baea2223d12 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:31 devstack sudo[92164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502 Jul 08 01:03:31 devstack sudo[92164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:32 devstack sudo[92164]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d3c4a72e-9f28-4cc8-8122-4baea2223d12 tempest-GroupSnapshotsTest-1813075391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502" returned: 0 in 0.930s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d3c4a72e-9f28-4cc8-8122-4baea2223d12 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:32 devstack sudo[92170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2 1G Jul 08 01:03:32 devstack sudo[92170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:33 devstack sudo[92170]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d3c4a72e-9f28-4cc8-8122-4baea2223d12 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2 1G" returned: 0 in 1.143s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d3c4a72e-9f28-4cc8-8122-4baea2223d12 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51de83e4-9275-48a5-b1c6-bb6165fac502 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:33 devstack sudo[92201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51de83e4-9275-48a5-b1c6-bb6165fac502 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2 Jul 08 01:03:33 devstack sudo[92201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:34 devstack sudo[92201]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d3c4a72e-9f28-4cc8-8122-4baea2223d12 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-51de83e4-9275-48a5-b1c6-bb6165fac502 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2" returned: 0 in 0.934s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:34 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-d3c4a72e-9f28-4cc8-8122-4baea2223d12 tempest-GroupSnapshotsTest-1813075391 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:03:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d3c4a72e-9f28-4cc8-8122-4baea2223d12 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:34 devstack sudo[92209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2 Jul 08 01:03:34 devstack sudo[92209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:35 devstack sudo[92209]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d3c4a72e-9f28-4cc8-8122-4baea2223d12 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2" returned: 0 in 0.919s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d3c4a72e-9f28-4cc8-8122-4baea2223d12 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:35 devstack sudo[92214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.info Jul 08 01:03:35 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:36 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d3c4a72e-9f28-4cc8-8122-4baea2223d12 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.info" returned: 0 in 0.878s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:36 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-d3c4a72e-9f28-4cc8-8122-4baea2223d12 tempest-GroupSnapshotsTest-1813075391 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:03:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d3c4a72e-9f28-4cc8-8122-4baea2223d12 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:36 devstack sudo[92217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.info Jul 08 01:03:36 devstack sudo[92217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:37 devstack sudo[92217]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d3c4a72e-9f28-4cc8-8122-4baea2223d12 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.info" returned: 0 in 0.853s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d3c4a72e-9f28-4cc8-8122-4baea2223d12 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.769s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:37 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-d3c4a72e-9f28-4cc8-8122-4baea2223d12 tempest-GroupSnapshotsTest-1813075391 None] group_snapshot 28b9602d-2d55-42ca-b7be-58e43fb71fe6: created successfully Jul 08 01:03:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "cinder-quobyte-a34f9270-561d-4f93-8f9e-64df7e4f9ed2-148ff555-e79d-4c2f-93eb-fb137448d130" by "_create_volume_from_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:03:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-a34f9270-561d-4f93-8f9e-64df7e4f9ed2-148ff555-e79d-4c2f-93eb-fb137448d130" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:03:39 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Creating volume 148ff555-e79d-4c2f-93eb-fb137448d130 from snapshot a34f9270-561d-4f93-8f9e-64df7e4f9ed2 {{(pid=87123) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:03:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:39 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:03:39 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:03:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:39 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:03:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "cinder-quobyte-148ff555-e79d-4c2f-93eb-fb137448d130" by "_copy_volume_from_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:03:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-148ff555-e79d-4c2f-93eb-fb137448d130" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:03:39 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] snapshot: a34f9270-561d-4f93-8f9e-64df7e4f9ed2, volume: 148ff555-e79d-4c2f-93eb-fb137448d130, {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:03:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:39 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:03:39 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:03:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:39 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ce21e78-687a-44cf-a536-4151e1a5bec0]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:03:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:39 devstack sudo[92223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2 Jul 08 01:03:39 devstack sudo[92223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:40 devstack sudo[92223]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2" returned: 0 in 1.431s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51de83e4-9275-48a5-b1c6-bb6165fac502(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:03:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502 {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:03:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Creating direct copy from snapshot {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:03:40 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b06a6ae-ef92-4bfc-8723-5ff3f0604a7c]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:03:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:40 devstack sudo[92230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502 Jul 08 01:03:40 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:42 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502" returned: 0 in 1.282s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:42 devstack cinder-volume[87123]: DEBUG cinder.utils [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Path /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-148ff555-e79d-4c2f-93eb-fb137448d130 not found in is_blk_device check {{(pid=87123) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:03:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-148ff555-e79d-4c2f-93eb-fb137448d130 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:42 devstack sudo[92254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-148ff555-e79d-4c2f-93eb-fb137448d130 Jul 08 01:03:42 devstack sudo[92254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:03:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:03:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:03:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:45 devstack sudo[92287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:03:45 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:45 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-7e56c228-9cf5-4af3-97fb-4bc2e6367cac req-027c56ce-87b6-4a18-8c93-532910757b08 tempest-ServerActionsTestOtherA-2051284359 None] Terminate volume connection completed successfully. Jul 08 01:03:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-7e56c228-9cf5-4af3-97fb-4bc2e6367cac req-027c56ce-87b6-4a18-8c93-532910757b08 tempest-ServerActionsTestOtherA-2051284359 None] Deleting attachment f84dcf0e-fffb-4961-b30f-a4c8ae6c536a. {{(pid=87123) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:03:47 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 2.477s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:47 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:03:47 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:03:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 8 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:03:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:03:50 devstack sudo[92254]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-148ff555-e79d-4c2f-93eb-fb137448d130" returned: 0 in 8.167s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:50 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[e175e653-8513-4fca-aefd-9a9363a25a6e]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:03:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:50 devstack sudo[92322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502 Jul 08 01:03:50 devstack sudo[92322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:52 devstack sudo[92322]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502" returned: 0 in 1.875s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:52 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Image conversion details: src /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502, size 1024.00 MB, duration 8.17 sec, destination /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-148ff555-e79d-4c2f-93eb-fb137448d130 {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:03:52 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Converted 1024.00 MB image at 125.32 MB/s Jul 08 01:03:52 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-148ff555-e79d-4c2f-93eb-fb137448d130 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:03:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-148ff555-e79d-4c2f-93eb-fb137448d130 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:52 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-148ff555-e79d-4c2f-93eb-fb137448d130 Jul 08 01:03:52 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:53 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-148ff555-e79d-4c2f-93eb-fb137448d130" returned: 0 in 1.215s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-148ff555-e79d-4c2f-93eb-fb137448d130" released by "_copy_volume_from_snapshot" :: held 14.149s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:03:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-a34f9270-561d-4f93-8f9e-64df7e4f9ed2-148ff555-e79d-4c2f-93eb-fb137448d130" released by "_create_volume_from_snapshot" :: held 14.201s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:03:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.223s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:53 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:UPDATE=85,cinder:INSERT=15,cinder:SELECT=71,cinder:DELETE=8 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:03:53 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=75,cinder:UPDATE=71,cinder:INSERT=17,cinder:DELETE=5 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:03:53 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-0409da85-65b9-4c95-8c5a-04a9f040f0b3 tempest-GroupSnapshotsTest-1813075391 None] Create group from source-snapshot-28b9602d-2d55-42ca-b7be-58e43fb71fe6 completed successfully. Jul 08 01:03:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2318dd43-d3bf-4ad0-bf6d-45011a2115c7 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "cinder-quobyte-148ff555-e79d-4c2f-93eb-fb137448d130" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:03:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2318dd43-d3bf-4ad0-bf6d-45011a2115c7 tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-148ff555-e79d-4c2f-93eb-fb137448d130" acquired by "delete_volume" :: waited 0.061s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:03:54 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef75f10-2fda-4adb-8e4d-6a07375f6a06]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:03:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2318dd43-d3bf-4ad0-bf6d-45011a2115c7 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-148ff555-e79d-4c2f-93eb-fb137448d130 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:55 devstack sudo[92371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-148ff555-e79d-4c2f-93eb-fb137448d130 Jul 08 01:03:55 devstack sudo[92371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:56 devstack sudo[92371]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2318dd43-d3bf-4ad0-bf6d-45011a2115c7 tempest-GroupSnapshotsTest-1813075391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-148ff555-e79d-4c2f-93eb-fb137448d130" returned: 0 in 1.526s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2318dd43-d3bf-4ad0-bf6d-45011a2115c7 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-148ff555-e79d-4c2f-93eb-fb137448d130 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:56 devstack sudo[92382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-148ff555-e79d-4c2f-93eb-fb137448d130 Jul 08 01:03:56 devstack sudo[92382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:57 devstack sudo[92382]: pam_unix(sudo:session): session closed for user root Jul 08 01:03:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2318dd43-d3bf-4ad0-bf6d-45011a2115c7 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-148ff555-e79d-4c2f-93eb-fb137448d130" returned: 0 in 1.228s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:03:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2318dd43-d3bf-4ad0-bf6d-45011a2115c7 tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-148ff555-e79d-4c2f-93eb-fb137448d130" released by "delete_volume" :: held 2.906s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:03:58 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-2318dd43-d3bf-4ad0-bf6d-45011a2115c7 tempest-GroupSnapshotsTest-1813075391 None] Created reservations ['d868de77-9802-4adc-b999-18a140762920'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:03:58 devstack cinder-volume[87123]: WARNING cinder.quota [None req-2318dd43-d3bf-4ad0-bf6d-45011a2115c7 tempest-GroupSnapshotsTest-1813075391 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-609733746 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-609733746, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:03:58 devstack cinder-volume[87123]: WARNING cinder.quota [None req-2318dd43-d3bf-4ad0-bf6d-45011a2115c7 tempest-GroupSnapshotsTest-1813075391 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-609733746 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-609733746, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:03:58 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-2318dd43-d3bf-4ad0-bf6d-45011a2115c7 tempest-GroupSnapshotsTest-1813075391 None] Created reservations ['e5a47f57-5c0e-4982-94cd-1b7f6a2b254c', 'b1d95ca0-e618-418a-ae46-7eb1876e313b', '9d50996d-1e3a-43f8-8f86-2418b97dd09b', 'eaa89a5e-8164-4ae5-b733-b54d4a018297'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:03:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-705e360e-bb09-42c4-814b-9d094c641841 tempest-ServerActionsTestOtherA-2051284359 None] Acquiring lock "cinder-987ecbdb-211d-43e1-a024-b48a915f7fa7-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:03:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2318dd43-d3bf-4ad0-bf6d-45011a2115c7 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:03:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2318dd43-d3bf-4ad0-bf6d-45011a2115c7 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:03:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2318dd43-d3bf-4ad0-bf6d-45011a2115c7 tempest-GroupSnapshotsTest-1813075391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:03:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2318dd43-d3bf-4ad0-bf6d-45011a2115c7 tempest-GroupSnapshotsTest-1813075391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:03:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2318dd43-d3bf-4ad0-bf6d-45011a2115c7 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:03:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2318dd43-d3bf-4ad0-bf6d-45011a2115c7 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-705e360e-bb09-42c4-814b-9d094c641841 tempest-ServerActionsTestOtherA-2051284359 None] Lock "cinder-987ecbdb-211d-43e1-a024-b48a915f7fa7-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:03:58 devstack sudo[92404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:03:58 devstack sudo[92404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-705e360e-bb09-42c4-814b-9d094c641841 tempest-ServerActionsTestOtherA-2051284359 None] Acquiring lock "cinder-quobyte-987ecbdb-211d-43e1-a024-b48a915f7fa7" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:03:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-705e360e-bb09-42c4-814b-9d094c641841 tempest-ServerActionsTestOtherA-2051284359 None] Lock "cinder-quobyte-987ecbdb-211d-43e1-a024-b48a915f7fa7" acquired by "delete_volume" :: waited 0.026s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:03:58 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dabc5e-60c3-4e01-8acd-44c938fd5cfd]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:03:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-705e360e-bb09-42c4-814b-9d094c641841 tempest-ServerActionsTestOtherA-2051284359 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-987ecbdb-211d-43e1-a024-b48a915f7fa7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:58 devstack sudo[92406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-987ecbdb-211d-43e1-a024-b48a915f7fa7 Jul 08 01:03:58 devstack sudo[92406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:03:59 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b5b90cbc-7785-4a1e-b736-85cdd5454e82 tempest-GroupSnapshotsTest-1813075391 None] group_snapshot 28b9602d-2d55-42ca-b7be-58e43fb71fe6: deleting Jul 08 01:03:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b5b90cbc-7785-4a1e-b736-85cdd5454e82 tempest-GroupSnapshotsTest-1813075391 None] group_snapshot 28b9602d-2d55-42ca-b7be-58e43fb71fe6: deleting {{(pid=87123) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 01:03:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b5b90cbc-7785-4a1e-b736-85cdd5454e82 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "cinder-quobyte-51de83e4-9275-48a5-b1c6-bb6165fac502" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:03:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b5b90cbc-7785-4a1e-b736-85cdd5454e82 tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-51de83e4-9275-48a5-b1c6-bb6165fac502" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:03:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b5b90cbc-7785-4a1e-b736-85cdd5454e82 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "cinder-quobyte-a34f9270-561d-4f93-8f9e-64df7e4f9ed2" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:03:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b5b90cbc-7785-4a1e-b736-85cdd5454e82 tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-a34f9270-561d-4f93-8f9e-64df7e4f9ed2" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:03:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-b5b90cbc-7785-4a1e-b736-85cdd5454e82 tempest-GroupSnapshotsTest-1813075391 None] Deleting offline snapshot a34f9270-561d-4f93-8f9e-64df7e4f9ed2 of volume 51de83e4-9275-48a5-b1c6-bb6165fac502 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:03:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-b5b90cbc-7785-4a1e-b736-85cdd5454e82 tempest-GroupSnapshotsTest-1813075391 None] snapshot_file for this snap is: volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:03:59 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0dc79d-6366-480c-9560-72ad1e512dbf]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:03:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b5b90cbc-7785-4a1e-b736-85cdd5454e82 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:03:59 devstack sudo[92409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2 Jul 08 01:03:59 devstack sudo[92409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:00 devstack sudo[92404]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2318dd43-d3bf-4ad0-bf6d-45011a2115c7 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.765s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:00 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-2318dd43-d3bf-4ad0-bf6d-45011a2115c7 tempest-GroupSnapshotsTest-1813075391 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:04:00 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-2318dd43-d3bf-4ad0-bf6d-45011a2115c7 tempest-GroupSnapshotsTest-1813075391 None] Delete group completed successfully. Jul 08 01:04:00 devstack sudo[92406]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-705e360e-bb09-42c4-814b-9d094c641841 tempest-ServerActionsTestOtherA-2051284359 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-987ecbdb-211d-43e1-a024-b48a915f7fa7" returned: 0 in 1.708s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-705e360e-bb09-42c4-814b-9d094c641841 tempest-ServerActionsTestOtherA-2051284359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-987ecbdb-211d-43e1-a024-b48a915f7fa7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:00 devstack sudo[92417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-987ecbdb-211d-43e1-a024-b48a915f7fa7 Jul 08 01:04:00 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:00 devstack sudo[92409]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b5b90cbc-7785-4a1e-b736-85cdd5454e82 tempest-GroupSnapshotsTest-1813075391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2" returned: 0 in 1.563s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-b5b90cbc-7785-4a1e-b736-85cdd5454e82 tempest-GroupSnapshotsTest-1813075391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-51de83e4-9275-48a5-b1c6-bb6165fac502(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:04:01 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fa87af-da2d-4ebb-a8e2-28389e10386e]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:04:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b5b90cbc-7785-4a1e-b736-85cdd5454e82 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:01 devstack sudo[92422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502 Jul 08 01:04:01 devstack sudo[92422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:01 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-705e360e-bb09-42c4-814b-9d094c641841 tempest-ServerActionsTestOtherA-2051284359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-987ecbdb-211d-43e1-a024-b48a915f7fa7" returned: 0 in 1.095s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:01 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-705e360e-bb09-42c4-814b-9d094c641841 tempest-ServerActionsTestOtherA-2051284359 None] Lock "cinder-quobyte-987ecbdb-211d-43e1-a024-b48a915f7fa7" released by "delete_volume" :: held 2.880s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:04:01 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-705e360e-bb09-42c4-814b-9d094c641841 tempest-ServerActionsTestOtherA-2051284359 None] Created reservations ['8f84b829-8b88-4bd5-8ae9-985897ee6705', 'fe9d659f-b804-4297-bcbb-3b71900e3f0c', '46a27868-e302-4606-a73d-5b555fad8d7e', 'f39ec8d2-8f3a-4361-b312-0e5621f4c19f'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:04:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-705e360e-bb09-42c4-814b-9d094c641841 tempest-ServerActionsTestOtherA-2051284359 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-705e360e-bb09-42c4-814b-9d094c641841 tempest-ServerActionsTestOtherA-2051284359 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-705e360e-bb09-42c4-814b-9d094c641841 tempest-ServerActionsTestOtherA-2051284359 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:04:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-705e360e-bb09-42c4-814b-9d094c641841 tempest-ServerActionsTestOtherA-2051284359 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:04:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-705e360e-bb09-42c4-814b-9d094c641841 tempest-ServerActionsTestOtherA-2051284359 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-705e360e-bb09-42c4-814b-9d094c641841 tempest-ServerActionsTestOtherA-2051284359 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:01 devstack sudo[92425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:04:01 devstack sudo[92425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:02 devstack sudo[92422]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b5b90cbc-7785-4a1e-b736-85cdd5454e82 tempest-GroupSnapshotsTest-1813075391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502" returned: 0 in 1.409s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b5b90cbc-7785-4a1e-b736-85cdd5454e82 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:02 devstack sudo[92431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2 Jul 08 01:04:02 devstack sudo[92431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:02 devstack sudo[92425]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-705e360e-bb09-42c4-814b-9d094c641841 tempest-ServerActionsTestOtherA-2051284359 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.185s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-705e360e-bb09-42c4-814b-9d094c641841 tempest-ServerActionsTestOtherA-2051284359 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:04:02 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-705e360e-bb09-42c4-814b-9d094c641841 tempest-ServerActionsTestOtherA-2051284359 None] Deleted volume successfully. Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-705e360e-bb09-42c4-814b-9d094c641841 tempest-ServerActionsTestOtherA-2051284359 None] Lock "cinder-987ecbdb-211d-43e1-a024-b48a915f7fa7-delete_volume" released by "delete_volume" :: held 4.449s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Flow 'volume_create_manager' (f950230a-31c0-4df9-b14b-25660294e0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2021c890-d7bd-460d-82dc-3349334e8791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2021c890-d7bd-460d-82dc-3349334e8791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-530489472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68fd79c6-3315-45d1-a65f-9fb39f98d14e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba14d630656046ce92b8cdeae7bee24d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:04:03Z,use_quota=True,user_id='78f808ca8334435580728ea12b6ac6f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61393610-4671-45ee-ae22-17f8e03acda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61393610-4671-45ee-ae22-17f8e03acda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8b163d-2f09-4b6e-b434-40c680e16819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8b163d-2f09-4b6e-b434-40c680e16819) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68fd79c6-3315-45d1-a65f-9fb39f98d14e', 'volume_name': 'volume-68fd79c6-3315-45d1-a65f-9fb39f98d14e', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37a3090-a662-4941-a144-d3256c76744e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37a3090-a662-4941-a144-d3256c76744e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8479689a-81c4-479a-9510-f33a781433c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:02 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Volume 68fd79c6-3315-45d1-a65f-9fb39f98d14e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68fd79c6-3315-45d1-a65f-9fb39f98d14e', 'volume_size': 1} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:04:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-530489472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68fd79c6-3315-45d1-a65f-9fb39f98d14e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba14d630656046ce92b8cdeae7bee24d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:04:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:04:03Z,use_quota=True,user_id='78f808ca8334435580728ea12b6ac6f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Creating volume 68fd79c6-3315-45d1-a65f-9fb39f98d14e {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:04:02 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:04:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-68fd79c6-3315-45d1-a65f-9fb39f98d14e 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:03 devstack sudo[92434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-68fd79c6-3315-45d1-a65f-9fb39f98d14e 1073741824 Jul 08 01:04:03 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:03 devstack sudo[92431]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b5b90cbc-7785-4a1e-b736-85cdd5454e82 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2" returned: 0 in 1.163s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b5b90cbc-7785-4a1e-b736-85cdd5454e82 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:03 devstack sudo[92446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2 Jul 08 01:04:03 devstack sudo[92446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:04 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-68fd79c6-3315-45d1-a65f-9fb39f98d14e 1073741824" returned: 0 in 1.341s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-68fd79c6-3315-45d1-a65f-9fb39f98d14e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:04 devstack sudo[92467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-68fd79c6-3315-45d1-a65f-9fb39f98d14e Jul 08 01:04:04 devstack sudo[92467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:04 devstack sudo[92446]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b5b90cbc-7785-4a1e-b736-85cdd5454e82 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502.a34f9270-561d-4f93-8f9e-64df7e4f9ed2" returned: 0 in 1.325s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:05 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b5b90cbc-7785-4a1e-b736-85cdd5454e82 tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-a34f9270-561d-4f93-8f9e-64df7e4f9ed2" released by "_delete_snapshot" :: held 5.696s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:04:05 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b5b90cbc-7785-4a1e-b736-85cdd5454e82 tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-51de83e4-9275-48a5-b1c6-bb6165fac502" released by "delete_snapshot" :: held 5.750s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:04:05 devstack cinder-volume[87123]: WARNING cinder.quota [None req-b5b90cbc-7785-4a1e-b736-85cdd5454e82 tempest-GroupSnapshotsTest-1813075391 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-609733746 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-609733746, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:04:05 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-b5b90cbc-7785-4a1e-b736-85cdd5454e82 tempest-GroupSnapshotsTest-1813075391 None] Created reservations ['94de52d3-a059-4124-bc76-17aaa98d9201', '51d64643-19be-4083-9463-f4b99d540626', 'b5625b7b-a37a-4d94-8f37-923d3f04ec3d', 'bfb10d71-ccec-46c4-805b-f93a63b34f62'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:04:05 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b5b90cbc-7785-4a1e-b736-85cdd5454e82 tempest-GroupSnapshotsTest-1813075391 None] group_snapshot 28b9602d-2d55-42ca-b7be-58e43fb71fe6: deleted successfully Jul 08 01:04:05 devstack sudo[92467]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-68fd79c6-3315-45d1-a65f-9fb39f98d14e" returned: 0 in 1.278s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:05 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] <== create_volume: return (2702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:04:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.706s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8479689a-81c4-479a-9510-f33a781433c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68fd79c6-3315-45d1-a65f-9fb39f98d14e', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24efbab4-1940-4b64-9ecf-680354c0a03c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:05 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Volume volume-68fd79c6-3315-45d1-a65f-9fb39f98d14e (68fd79c6-3315-45d1-a65f-9fb39f98d14e): created successfully Jul 08 01:04:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24efbab4-1940-4b64-9ecf-680354c0a03c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Flow 'volume_create_manager' (f950230a-31c0-4df9-b14b-25660294e0b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:04:05 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-bab5512e-b8aa-4e64-a4a5-63b096fe1d45 tempest-VolumesMetadataTest-760299275 None] Created volume successfully. Jul 08 01:04:06 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f8f3081d-10e9-48b9-b051-0d96971fc372 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "cinder-quobyte-51de83e4-9275-48a5-b1c6-bb6165fac502" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:04:06 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f8f3081d-10e9-48b9-b051-0d96971fc372 tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-51de83e4-9275-48a5-b1c6-bb6165fac502" acquired by "delete_volume" :: waited 0.031s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:04:06 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[875a7217-5fee-4094-8b12-40df876053c2]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:04:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f8f3081d-10e9-48b9-b051-0d96971fc372 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:06 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502 Jul 08 01:04:06 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0e5f0af6-d5f0-480d-a447-90a7e9e723f3 tempest-VolumesMetadataTest-760299275 None] Acquiring lock "cinder-68fd79c6-3315-45d1-a65f-9fb39f98d14e-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:04:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0e5f0af6-d5f0-480d-a447-90a7e9e723f3 tempest-VolumesMetadataTest-760299275 None] Lock "cinder-68fd79c6-3315-45d1-a65f-9fb39f98d14e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:04:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0e5f0af6-d5f0-480d-a447-90a7e9e723f3 tempest-VolumesMetadataTest-760299275 None] Acquiring lock "cinder-quobyte-68fd79c6-3315-45d1-a65f-9fb39f98d14e" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:04:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0e5f0af6-d5f0-480d-a447-90a7e9e723f3 tempest-VolumesMetadataTest-760299275 None] Lock "cinder-quobyte-68fd79c6-3315-45d1-a65f-9fb39f98d14e" acquired by "delete_volume" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:04:07 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceee3204-4080-4ed5-99eb-eb8b76fbc078]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:04:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0e5f0af6-d5f0-480d-a447-90a7e9e723f3 tempest-VolumesMetadataTest-760299275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-68fd79c6-3315-45d1-a65f-9fb39f98d14e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:07 devstack sudo[92533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-68fd79c6-3315-45d1-a65f-9fb39f98d14e Jul 08 01:04:07 devstack sudo[92533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:07 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f8f3081d-10e9-48b9-b051-0d96971fc372 tempest-GroupSnapshotsTest-1813075391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502" returned: 0 in 1.183s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f8f3081d-10e9-48b9-b051-0d96971fc372 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:07 devstack sudo[92538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502 Jul 08 01:04:07 devstack sudo[92538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:08 devstack sudo[92533]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0e5f0af6-d5f0-480d-a447-90a7e9e723f3 tempest-VolumesMetadataTest-760299275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-68fd79c6-3315-45d1-a65f-9fb39f98d14e" returned: 0 in 0.929s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0e5f0af6-d5f0-480d-a447-90a7e9e723f3 tempest-VolumesMetadataTest-760299275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-68fd79c6-3315-45d1-a65f-9fb39f98d14e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:08 devstack sudo[92543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-68fd79c6-3315-45d1-a65f-9fb39f98d14e Jul 08 01:04:08 devstack sudo[92543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:08 devstack sudo[92538]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f8f3081d-10e9-48b9-b051-0d96971fc372 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-51de83e4-9275-48a5-b1c6-bb6165fac502" returned: 0 in 0.877s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:08 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f8f3081d-10e9-48b9-b051-0d96971fc372 tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-51de83e4-9275-48a5-b1c6-bb6165fac502" released by "delete_volume" :: held 2.177s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:04:08 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-f8f3081d-10e9-48b9-b051-0d96971fc372 tempest-GroupSnapshotsTest-1813075391 None] Created reservations ['e07081bc-cbfc-42ba-a08f-78c2310e8c5f'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:04:08 devstack cinder-volume[87123]: WARNING cinder.db.api [None req-f8f3081d-10e9-48b9-b051-0d96971fc372 tempest-GroupSnapshotsTest-1813075391 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-609733746'] Jul 08 01:04:08 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-f8f3081d-10e9-48b9-b051-0d96971fc372 tempest-GroupSnapshotsTest-1813075391 None] Created reservations ['4fc8b509-968d-426e-abed-c2e2067b8296', 'ef3d37ec-b7a1-4f7e-aeb0-083d7896df46', 'd026b4de-06ac-4220-9340-4d93921f6811', '2feca956-d00e-483c-a5f1-5cb3ba57c4ac'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:04:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f8f3081d-10e9-48b9-b051-0d96971fc372 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f8f3081d-10e9-48b9-b051-0d96971fc372 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f8f3081d-10e9-48b9-b051-0d96971fc372 tempest-GroupSnapshotsTest-1813075391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:04:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f8f3081d-10e9-48b9-b051-0d96971fc372 tempest-GroupSnapshotsTest-1813075391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:04:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f8f3081d-10e9-48b9-b051-0d96971fc372 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f8f3081d-10e9-48b9-b051-0d96971fc372 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:09 devstack sudo[92546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:04:09 devstack sudo[92546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:09 devstack sudo[92543]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0e5f0af6-d5f0-480d-a447-90a7e9e723f3 tempest-VolumesMetadataTest-760299275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-68fd79c6-3315-45d1-a65f-9fb39f98d14e" returned: 0 in 0.771s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0e5f0af6-d5f0-480d-a447-90a7e9e723f3 tempest-VolumesMetadataTest-760299275 None] Lock "cinder-quobyte-68fd79c6-3315-45d1-a65f-9fb39f98d14e" released by "delete_volume" :: held 1.779s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:04:09 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-0e5f0af6-d5f0-480d-a447-90a7e9e723f3 tempest-VolumesMetadataTest-760299275 None] Created reservations ['1ed9208d-0bd6-44e3-8057-466e2f736e9e', 'd92ff88d-c59c-46ce-9de5-ed1b5b6d7725', 'd2dfac1f-8cf1-483e-bf76-f422b54b64d3', 'ea3d805a-62ef-42c8-a964-07605382d488'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:04:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0e5f0af6-d5f0-480d-a447-90a7e9e723f3 tempest-VolumesMetadataTest-760299275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0e5f0af6-d5f0-480d-a447-90a7e9e723f3 tempest-VolumesMetadataTest-760299275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0e5f0af6-d5f0-480d-a447-90a7e9e723f3 tempest-VolumesMetadataTest-760299275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:04:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0e5f0af6-d5f0-480d-a447-90a7e9e723f3 tempest-VolumesMetadataTest-760299275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:04:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0e5f0af6-d5f0-480d-a447-90a7e9e723f3 tempest-VolumesMetadataTest-760299275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0e5f0af6-d5f0-480d-a447-90a7e9e723f3 tempest-VolumesMetadataTest-760299275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:09 devstack sudo[92549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:04:09 devstack sudo[92549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:09 devstack sudo[92546]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f8f3081d-10e9-48b9-b051-0d96971fc372 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.796s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:09 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-f8f3081d-10e9-48b9-b051-0d96971fc372 tempest-GroupSnapshotsTest-1813075391 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:04:09 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f8f3081d-10e9-48b9-b051-0d96971fc372 tempest-GroupSnapshotsTest-1813075391 None] Delete group completed successfully. Jul 08 01:04:10 devstack sudo[92549]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0e5f0af6-d5f0-480d-a447-90a7e9e723f3 tempest-VolumesMetadataTest-760299275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.750s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:10 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-0e5f0af6-d5f0-480d-a447-90a7e9e723f3 tempest-VolumesMetadataTest-760299275 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:04:10 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-0e5f0af6-d5f0-480d-a447-90a7e9e723f3 tempest-VolumesMetadataTest-760299275 None] Deleted volume successfully. Jul 08 01:04:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0e5f0af6-d5f0-480d-a447-90a7e9e723f3 tempest-VolumesMetadataTest-760299275 None] Lock "cinder-68fd79c6-3315-45d1-a65f-9fb39f98d14e-delete_volume" released by "delete_volume" :: held 2.807s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:04:10 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-ca75b66c-6550-4033-b9de-03fe6bb72234 tempest-GroupSnapshotsTest-1813075391 None] Group tempest-GroupSnapshotsTest-Group-1830058568: creating Jul 08 01:04:10 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-ca75b66c-6550-4033-b9de-03fe6bb72234 tempest-GroupSnapshotsTest-1813075391 None] Group tempest-GroupSnapshotsTest-Group-1830058568: created successfully Jul 08 01:04:10 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-ca75b66c-6550-4033-b9de-03fe6bb72234 tempest-GroupSnapshotsTest-1813075391 None] Create group completed successfully. Jul 08 01:04:12 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:04:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Flow 'volume_create_manager' (89aeff1e-ad3e-466c-9858-9bf5f97abd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:04:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d13a636-0dd4-47ca-9819-3bdec53dfdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d13a636-0dd4-47ca-9819-3bdec53dfdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-377434943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b16cdb15-76c1-4d3b-995d-caa7de089f62,host='devstack@QuobyteHD#QuobyteHD',id=0e2eafd1-89de-4030-8c43-1a7f09a29979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735fa01232f0474fb478aed2dd8f744a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:04:13Z,use_quota=True,user_id='8a1f6bb8f1be45139832c6fd53993dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f92f04f-aeb4-4db1-a032-ca294f129e97),volume_type_id=5f92f04f-aeb4-4db1-a032-ca294f129e97)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4496f99-4962-42b1-ab8b-1989111f60aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4496f99-4962-42b1-ab8b-1989111f60aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0584164-5ac6-4ded-ba86-86d156bbaf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0584164-5ac6-4ded-ba86-86d156bbaf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e2eafd1-89de-4030-8c43-1a7f09a29979', 'volume_name': 'volume-0e2eafd1-89de-4030-8c43-1a7f09a29979', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158db356-79d1-45fd-9b66-6b206ce47a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (158db356-79d1-45fd-9b66-6b206ce47a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1df2ab0-dbda-43c3-9fb3-8d8e66ad8643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:12 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Volume 0e2eafd1-89de-4030-8c43-1a7f09a29979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e2eafd1-89de-4030-8c43-1a7f09a29979', 'volume_size': 1} Jul 08 01:04:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b16cdb15-76c1-4d3b-995d-caa7de089f62,created_at=2026-07-07T23:04:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-377434943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b16cdb15-76c1-4d3b-995d-caa7de089f62,host='devstack@QuobyteHD#QuobyteHD',id=0e2eafd1-89de-4030-8c43-1a7f09a29979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735fa01232f0474fb478aed2dd8f744a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:04:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:04:13Z,use_quota=True,user_id='8a1f6bb8f1be45139832c6fd53993dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f92f04f-aeb4-4db1-a032-ca294f129e97),volume_type_id=5f92f04f-aeb4-4db1-a032-ca294f129e97)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:04:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Creating volume 0e2eafd1-89de-4030-8c43-1a7f09a29979 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:04:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:04:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:04:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:04:12 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:04:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:12 devstack sudo[92555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979 1073741824 Jul 08 01:04:12 devstack sudo[92555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:14 devstack sudo[92555]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979 1073741824" returned: 0 in 1.306s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:14 devstack sudo[92576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979 Jul 08 01:04:14 devstack sudo[92576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:15 devstack sudo[92576]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979" returned: 0 in 0.916s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] <== create_volume: return (2289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:04:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.293s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1df2ab0-dbda-43c3-9fb3-8d8e66ad8643) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e2eafd1-89de-4030-8c43-1a7f09a29979', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86447cb6-92b1-4301-8f48-3374f9b7d3f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:15 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Volume volume-0e2eafd1-89de-4030-8c43-1a7f09a29979 (0e2eafd1-89de-4030-8c43-1a7f09a29979): created successfully Jul 08 01:04:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86447cb6-92b1-4301-8f48-3374f9b7d3f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Flow 'volume_create_manager' (89aeff1e-ad3e-466c-9858-9bf5f97abd19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:04:15 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f3013c31-9dfb-4fac-8416-9cbfdbfbbd46 tempest-GroupSnapshotsTest-1813075391 None] Created volume successfully. Jul 08 01:04:16 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:04:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Flow 'volume_create_manager' (ed24189d-27cc-4eb1-8a65-c1946a9d8d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:04:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec1b90f-e34d-4278-9337-c99bf87b9a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ec1b90f-e34d-4278-9337-c99bf87b9a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1064046418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b95598d-c0df-4ecf-9367-226befee9240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b42b9fc96894eb4b462534ced83606d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:04:16Z,use_quota=True,user_id='360859b1b4314ad9a012cf6473ada272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d8cf55-d1cf-49d4-a59b-b8f45b4d66bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0d8cf55-d1cf-49d4-a59b-b8f45b4d66bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da7cee3-2353-49c4-8ae7-4c768d21617e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6da7cee3-2353-49c4-8ae7-4c768d21617e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b95598d-c0df-4ecf-9367-226befee9240', 'volume_name': 'volume-4b95598d-c0df-4ecf-9367-226befee9240', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d832a3c-db18-4161-8ec8-e86eaee236d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d832a3c-db18-4161-8ec8-e86eaee236d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beac5dce-d9de-4eb0-be8f-1177eb366bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:16 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Volume 4b95598d-c0df-4ecf-9367-226befee9240: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b95598d-c0df-4ecf-9367-226befee9240', 'volume_size': 1} Jul 08 01:04:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:04:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1064046418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b95598d-c0df-4ecf-9367-226befee9240,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b42b9fc96894eb4b462534ced83606d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:04:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:04:16Z,use_quota=True,user_id='360859b1b4314ad9a012cf6473ada272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:04:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Creating volume 4b95598d-c0df-4ecf-9367-226befee9240 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:04:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:04:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:04:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:04:16 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:04:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4b95598d-c0df-4ecf-9367-226befee9240 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:16 devstack sudo[92579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4b95598d-c0df-4ecf-9367-226befee9240 1073741824 Jul 08 01:04:16 devstack sudo[92579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:17 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:04:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Flow 'volume_create_manager' (2590558b-2615-4e5a-b626-de8aec8d496e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:04:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee2c7fe-7bde-4d08-bfa6-a934b2d8a8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ee2c7fe-7bde-4d08-bfa6-a934b2d8a8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-134258893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b16cdb15-76c1-4d3b-995d-caa7de089f62,host='devstack@QuobyteHD#QuobyteHD',id=b436f1d7-59d9-4b2d-93d7-815f17b5cb43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735fa01232f0474fb478aed2dd8f744a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:04:17Z,use_quota=True,user_id='8a1f6bb8f1be45139832c6fd53993dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f92f04f-aeb4-4db1-a032-ca294f129e97),volume_type_id=5f92f04f-aeb4-4db1-a032-ca294f129e97)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f4288e-f339-4bce-8f22-f7782221ca9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7f4288e-f339-4bce-8f22-f7782221ca9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5660ccc5-3e6b-4e1d-a690-aea54707f916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5660ccc5-3e6b-4e1d-a690-aea54707f916) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b436f1d7-59d9-4b2d-93d7-815f17b5cb43', 'volume_name': 'volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f111b3-b81b-494e-a8ce-61e918588425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f111b3-b81b-494e-a8ce-61e918588425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a429850-c115-4abf-ab4c-770d3d51c35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:17 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Volume b436f1d7-59d9-4b2d-93d7-815f17b5cb43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43', 'volume_size': 1} Jul 08 01:04:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:17 devstack sudo[92579]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4b95598d-c0df-4ecf-9367-226befee9240 1073741824" returned: 0 in 1.217s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4b95598d-c0df-4ecf-9367-226befee9240 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:17 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4b95598d-c0df-4ecf-9367-226befee9240 Jul 08 01:04:17 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:18 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4b95598d-c0df-4ecf-9367-226befee9240" returned: 0 in 0.879s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] <== create_volume: return (2144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:04:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.148s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.143s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b16cdb15-76c1-4d3b-995d-caa7de089f62,created_at=2026-07-07T23:04:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-134258893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b16cdb15-76c1-4d3b-995d-caa7de089f62,host='devstack@QuobyteHD#QuobyteHD',id=b436f1d7-59d9-4b2d-93d7-815f17b5cb43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735fa01232f0474fb478aed2dd8f744a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:04:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:04:17Z,use_quota=True,user_id='8a1f6bb8f1be45139832c6fd53993dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5f92f04f-aeb4-4db1-a032-ca294f129e97),volume_type_id=5f92f04f-aeb4-4db1-a032-ca294f129e97)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:04:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Creating volume b436f1d7-59d9-4b2d-93d7-815f17b5cb43 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:04:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:04:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:04:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:04:18 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:04:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:18 devstack sudo[92591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43 1073741824 Jul 08 01:04:18 devstack sudo[92591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beac5dce-d9de-4eb0-be8f-1177eb366bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b95598d-c0df-4ecf-9367-226befee9240', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a12328f7-445d-4fe5-a2b6-b62245050a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:18 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Volume volume-4b95598d-c0df-4ecf-9367-226befee9240 (4b95598d-c0df-4ecf-9367-226befee9240): created successfully Jul 08 01:04:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a12328f7-445d-4fe5-a2b6-b62245050a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Flow 'volume_create_manager' (ed24189d-27cc-4eb1-8a65-c1946a9d8d5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:04:18 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-a9bdbefd-e32f-42a7-b6cf-97031756acbc tempest-VolumesTransfersTest-1227995577 None] Created volume successfully. Jul 08 01:04:19 devstack sudo[92591]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43 1073741824" returned: 0 in 1.076s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:19 devstack sudo[92605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43 Jul 08 01:04:19 devstack sudo[92605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43" returned: 0 in 1.226s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] <== create_volume: return (2391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:04:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.398s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:20 devstack sudo[92605]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a429850-c115-4abf-ab4c-770d3d51c35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63ed16a-e1d8-4977-9923-026b82a92432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:21 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Volume volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43 (b436f1d7-59d9-4b2d-93d7-815f17b5cb43): created successfully Jul 08 01:04:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63ed16a-e1d8-4977-9923-026b82a92432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Flow 'volume_create_manager' (2590558b-2615-4e5a-b626-de8aec8d496e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:04:21 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-acfce025-05b6-4650-83d0-582dd9cd0a62 tempest-GroupSnapshotsTest-1813075391 None] Created volume successfully. Jul 08 01:04:21 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-7d8edb4a-4e81-46a4-a822-b60b4fb84572 tempest-VolumesTransfersTest-1989738367 None] Transfer volume completed successfully. Jul 08 01:04:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-be327468-f6d2-45c5-b49d-923d1037af2e tempest-VolumesTransfersTest-546253757 None] Acquiring lock "cinder-4b95598d-c0df-4ecf-9367-226befee9240-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:04:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-be327468-f6d2-45c5-b49d-923d1037af2e tempest-VolumesTransfersTest-546253757 None] Lock "cinder-4b95598d-c0df-4ecf-9367-226befee9240-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:04:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-be327468-f6d2-45c5-b49d-923d1037af2e tempest-VolumesTransfersTest-546253757 None] Acquiring lock "cinder-quobyte-4b95598d-c0df-4ecf-9367-226befee9240" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:04:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-be327468-f6d2-45c5-b49d-923d1037af2e tempest-VolumesTransfersTest-546253757 None] Lock "cinder-quobyte-4b95598d-c0df-4ecf-9367-226befee9240" acquired by "delete_volume" :: waited 0.026s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:04:22 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[7670d86b-1090-48b6-bdb7-e0045d2c3475]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:04:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-be327468-f6d2-45c5-b49d-923d1037af2e tempest-VolumesTransfersTest-546253757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4b95598d-c0df-4ecf-9367-226befee9240 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:22 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b34ad852-836a-4f87-87fd-06fb8494a3c9 tempest-GroupSnapshotsTest-1813075391 None] Update group completed successfully. Jul 08 01:04:22 devstack sudo[92635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4b95598d-c0df-4ecf-9367-226befee9240 Jul 08 01:04:22 devstack sudo[92635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:23 devstack sudo[92635]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-be327468-f6d2-45c5-b49d-923d1037af2e tempest-VolumesTransfersTest-546253757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4b95598d-c0df-4ecf-9367-226befee9240" returned: 0 in 0.883s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-be327468-f6d2-45c5-b49d-923d1037af2e tempest-VolumesTransfersTest-546253757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4b95598d-c0df-4ecf-9367-226befee9240 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:23 devstack sudo[92641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4b95598d-c0df-4ecf-9367-226befee9240 Jul 08 01:04:23 devstack sudo[92641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:24 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-54bfb830-42f6-4451-91b0-453938aaa4a1 tempest-GroupSnapshotsTest-1813075391 None] Update group completed successfully. Jul 08 01:04:24 devstack sudo[92641]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-be327468-f6d2-45c5-b49d-923d1037af2e tempest-VolumesTransfersTest-546253757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4b95598d-c0df-4ecf-9367-226befee9240" returned: 0 in 0.843s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-be327468-f6d2-45c5-b49d-923d1037af2e tempest-VolumesTransfersTest-546253757 None] Lock "cinder-quobyte-4b95598d-c0df-4ecf-9367-226befee9240" released by "delete_volume" :: held 1.801s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:04:24 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-be327468-f6d2-45c5-b49d-923d1037af2e tempest-VolumesTransfersTest-546253757 None] Created reservations ['efe8ac86-f4be-4262-95d9-2841cea48247', '7ddf9524-1a7d-4da7-80a1-47dd4d632f88', 'e2d44ca2-770a-4984-81b7-9a961bde24da', '887d9527-b256-4b73-ae58-10b5f85d7376'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:04:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-be327468-f6d2-45c5-b49d-923d1037af2e tempest-VolumesTransfersTest-546253757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-be327468-f6d2-45c5-b49d-923d1037af2e tempest-VolumesTransfersTest-546253757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-be327468-f6d2-45c5-b49d-923d1037af2e tempest-VolumesTransfersTest-546253757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:04:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-be327468-f6d2-45c5-b49d-923d1037af2e tempest-VolumesTransfersTest-546253757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:04:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-be327468-f6d2-45c5-b49d-923d1037af2e tempest-VolumesTransfersTest-546253757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-be327468-f6d2-45c5-b49d-923d1037af2e tempest-VolumesTransfersTest-546253757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:24 devstack sudo[92644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:04:24 devstack sudo[92644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:25 devstack sudo[92644]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-be327468-f6d2-45c5-b49d-923d1037af2e tempest-VolumesTransfersTest-546253757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.840s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-be327468-f6d2-45c5-b49d-923d1037af2e tempest-VolumesTransfersTest-546253757 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:04:25 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-be327468-f6d2-45c5-b49d-923d1037af2e tempest-VolumesTransfersTest-546253757 None] Deleted volume successfully. Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-be327468-f6d2-45c5-b49d-923d1037af2e tempest-VolumesTransfersTest-546253757 None] Lock "cinder-4b95598d-c0df-4ecf-9367-226befee9240-delete_volume" released by "delete_volume" :: held 2.951s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:04:25 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-cc85b6e5-c044-422a-b793-9361706c542d tempest-GroupSnapshotsTest-1813075391 None] Update group completed successfully. Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Flow 'volume_create_manager' (a6a39e03-da08-4c49-b319-390406d4d09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c825a7-5ba5-4c1d-9da2-0e2876fbe2ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01c825a7-5ba5-4c1d-9da2-0e2876fbe2ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-250008384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb46043-019f-4493-a0c8-e594d420240e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b42b9fc96894eb4b462534ced83606d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:04:25Z,use_quota=True,user_id='360859b1b4314ad9a012cf6473ada272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (975fd0d6-7fe4-432b-b0ee-9a7885271dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (975fd0d6-7fe4-432b-b0ee-9a7885271dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a155b2f-8e84-42d7-a2f9-92247f5d63cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a155b2f-8e84-42d7-a2f9-92247f5d63cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecb46043-019f-4493-a0c8-e594d420240e', 'volume_name': 'volume-ecb46043-019f-4493-a0c8-e594d420240e', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c696112-98a4-4fcb-bcb4-f7e6a9dd92a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c696112-98a4-4fcb-bcb4-f7e6a9dd92a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21095b8d-b40f-4668-9524-df00e62b8d0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:25 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Volume ecb46043-019f-4493-a0c8-e594d420240e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecb46043-019f-4493-a0c8-e594d420240e', 'volume_size': 1} Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:04:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-250008384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb46043-019f-4493-a0c8-e594d420240e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b42b9fc96894eb4b462534ced83606d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:04:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:04:25Z,use_quota=True,user_id='360859b1b4314ad9a012cf6473ada272',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Creating volume ecb46043-019f-4493-a0c8-e594d420240e {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:04:25 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:04:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ecb46043-019f-4493-a0c8-e594d420240e 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:25 devstack sudo[92647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ecb46043-019f-4493-a0c8-e594d420240e 1073741824 Jul 08 01:04:25 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:26 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ecb46043-019f-4493-a0c8-e594d420240e 1073741824" returned: 0 in 1.220s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:26 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-5e0d8188-af18-4288-890a-ca74408afc25 tempest-GroupSnapshotsTest-1813075391 None] Update group completed successfully. Jul 08 01:04:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ecb46043-019f-4493-a0c8-e594d420240e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:26 devstack sudo[92653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ecb46043-019f-4493-a0c8-e594d420240e Jul 08 01:04:26 devstack sudo[92653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:27 devstack sudo[92653]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ecb46043-019f-4493-a0c8-e594d420240e" returned: 0 in 0.800s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] <== create_volume: return (2109ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:04:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.112s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21095b8d-b40f-4668-9524-df00e62b8d0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecb46043-019f-4493-a0c8-e594d420240e', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b45419-637f-40dd-8ad0-8fd60a812b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:27 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Volume volume-ecb46043-019f-4493-a0c8-e594d420240e (ecb46043-019f-4493-a0c8-e594d420240e): created successfully Jul 08 01:04:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73b45419-637f-40dd-8ad0-8fd60a812b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Flow 'volume_create_manager' (a6a39e03-da08-4c49-b319-390406d4d09e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:04:27 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-461f4c29-092d-4579-b600-5e0ec9db0dd1 tempest-VolumesTransfersTest-1227995577 None] Created volume successfully. Jul 08 01:04:28 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] GroupSnapshot f0d212db-c4bd-43c6-9159-1404edbe1063: creating. Jul 08 01:04:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] Group snapshot f0d212db-c4bd-43c6-9159-1404edbe1063: creating. {{(pid=87123) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 01:04:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:28 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] Creating offline snapshot 9986fed4-943e-40ab-9610-400a72e0e97b of volume 0e2eafd1-89de-4030-8c43-1a7f09a29979 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:04:28 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[6beb22b3-9dfd-4ff4-a2fb-25758fd2a2cd]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:04:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:28 devstack sudo[92657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979 Jul 08 01:04:28 devstack sudo[92657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:29 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25e92a75-685b-411a-9262-ee8178b4ac27 tempest-VolumesTransfersTest-546253757 None] Acquiring lock "cinder-ecb46043-019f-4493-a0c8-e594d420240e-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:04:29 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25e92a75-685b-411a-9262-ee8178b4ac27 tempest-VolumesTransfersTest-546253757 None] Lock "cinder-ecb46043-019f-4493-a0c8-e594d420240e-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:04:29 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25e92a75-685b-411a-9262-ee8178b4ac27 tempest-VolumesTransfersTest-546253757 None] Acquiring lock "cinder-quobyte-ecb46043-019f-4493-a0c8-e594d420240e" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:04:29 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25e92a75-685b-411a-9262-ee8178b4ac27 tempest-VolumesTransfersTest-546253757 None] Lock "cinder-quobyte-ecb46043-019f-4493-a0c8-e594d420240e" acquired by "delete_volume" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:04:29 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb6a94bb-3871-47ee-bade-14268362abda]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:04:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25e92a75-685b-411a-9262-ee8178b4ac27 tempest-VolumesTransfersTest-546253757 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ecb46043-019f-4493-a0c8-e594d420240e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:29 devstack sudo[92659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ecb46043-019f-4493-a0c8-e594d420240e Jul 08 01:04:29 devstack sudo[92659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:29 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-2eca1c39-11fa-4b8a-a4c1-d652359cf615 req-40789103-f745-472d-8065-e9a1a5b8d216 tempest-AttachVolumeNegativeTest-1707411501 None] Terminate volume connection completed successfully. Jul 08 01:04:29 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-2eca1c39-11fa-4b8a-a4c1-d652359cf615 req-40789103-f745-472d-8065-e9a1a5b8d216 tempest-AttachVolumeNegativeTest-1707411501 None] Deleting attachment f400c114-e1e8-49db-a260-a613baae6dc3. {{(pid=87123) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:04:29 devstack sudo[92657]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979" returned: 0 in 1.328s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.9986fed4-943e-40ab-9610-400a72e0e97b 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:29 devstack sudo[92668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.9986fed4-943e-40ab-9610-400a72e0e97b 1G Jul 08 01:04:29 devstack sudo[92668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:30 devstack sudo[92659]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25e92a75-685b-411a-9262-ee8178b4ac27 tempest-VolumesTransfersTest-546253757 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ecb46043-019f-4493-a0c8-e594d420240e" returned: 0 in 1.247s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25e92a75-685b-411a-9262-ee8178b4ac27 tempest-VolumesTransfersTest-546253757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ecb46043-019f-4493-a0c8-e594d420240e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:30 devstack sudo[92674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ecb46043-019f-4493-a0c8-e594d420240e Jul 08 01:04:30 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:30 devstack sudo[92668]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.9986fed4-943e-40ab-9610-400a72e0e97b 1G" returned: 0 in 1.121s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e2eafd1-89de-4030-8c43-1a7f09a29979 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.9986fed4-943e-40ab-9610-400a72e0e97b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:31 devstack sudo[92680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e2eafd1-89de-4030-8c43-1a7f09a29979 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.9986fed4-943e-40ab-9610-400a72e0e97b Jul 08 01:04:31 devstack sudo[92680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:31 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25e92a75-685b-411a-9262-ee8178b4ac27 tempest-VolumesTransfersTest-546253757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ecb46043-019f-4493-a0c8-e594d420240e" returned: 0 in 0.809s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:31 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25e92a75-685b-411a-9262-ee8178b4ac27 tempest-VolumesTransfersTest-546253757 None] Lock "cinder-quobyte-ecb46043-019f-4493-a0c8-e594d420240e" released by "delete_volume" :: held 2.128s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:04:31 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-25e92a75-685b-411a-9262-ee8178b4ac27 tempest-VolumesTransfersTest-546253757 None] Created reservations ['a19f5b60-bb8c-4fae-904e-9cf65677c8b9', 'a7e0e9d2-7a17-4549-b9f1-c2d6f38270c9', '00cac24d-f84b-4e24-ac99-987bc9ceb89a', 'c4e21d6c-7bc8-4048-a17b-08c617e2ae16'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:04:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-25e92a75-685b-411a-9262-ee8178b4ac27 tempest-VolumesTransfersTest-546253757 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-25e92a75-685b-411a-9262-ee8178b4ac27 tempest-VolumesTransfersTest-546253757 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-25e92a75-685b-411a-9262-ee8178b4ac27 tempest-VolumesTransfersTest-546253757 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:04:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-25e92a75-685b-411a-9262-ee8178b4ac27 tempest-VolumesTransfersTest-546253757 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:04:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-25e92a75-685b-411a-9262-ee8178b4ac27 tempest-VolumesTransfersTest-546253757 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25e92a75-685b-411a-9262-ee8178b4ac27 tempest-VolumesTransfersTest-546253757 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:31 devstack sudo[92683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:04:31 devstack sudo[92683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:31 devstack sudo[92680]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0e2eafd1-89de-4030-8c43-1a7f09a29979 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.9986fed4-943e-40ab-9610-400a72e0e97b" returned: 0 in 0.971s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:31 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.9986fed4-943e-40ab-9610-400a72e0e97b is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:04:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.9986fed4-943e-40ab-9610-400a72e0e97b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:32 devstack sudo[92690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.9986fed4-943e-40ab-9610-400a72e0e97b Jul 08 01:04:32 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:32 devstack sudo[92683]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25e92a75-685b-411a-9262-ee8178b4ac27 tempest-VolumesTransfersTest-546253757 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.908s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:32 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-25e92a75-685b-411a-9262-ee8178b4ac27 tempest-VolumesTransfersTest-546253757 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:04:32 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-25e92a75-685b-411a-9262-ee8178b4ac27 tempest-VolumesTransfersTest-546253757 None] Deleted volume successfully. Jul 08 01:04:32 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25e92a75-685b-411a-9262-ee8178b4ac27 tempest-VolumesTransfersTest-546253757 None] Lock "cinder-ecb46043-019f-4493-a0c8-e594d420240e-delete_volume" released by "delete_volume" :: held 3.385s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:04:32 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.9986fed4-943e-40ab-9610-400a72e0e97b" returned: 0 in 0.829s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:32 devstack sudo[92694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.info Jul 08 01:04:32 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:34 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.info" returned: 0 in 1.209s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:34 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:04:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:34 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.info Jul 08 01:04:34 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:35 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.info" returned: 0 in 1.173s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.772s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] Creating offline snapshot a897c785-2cef-4f87-9144-c715e5806f65 of volume b436f1d7-59d9-4b2d-93d7-815f17b5cb43 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:04:35 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[6840c934-3dfe-461c-8cd4-82e0d0aeecda]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:04:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:35 devstack sudo[92720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43 Jul 08 01:04:35 devstack sudo[92720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:36 devstack sudo[92720]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43" returned: 0 in 1.166s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.a897c785-2cef-4f87-9144-c715e5806f65 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:36 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.a897c785-2cef-4f87-9144-c715e5806f65 1G Jul 08 01:04:36 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:37 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.a897c785-2cef-4f87-9144-c715e5806f65 1G" returned: 0 in 1.145s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.a897c785-2cef-4f87-9144-c715e5806f65 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:37 devstack sudo[92732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.a897c785-2cef-4f87-9144-c715e5806f65 Jul 08 01:04:37 devstack sudo[92732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:38 devstack sudo[92732]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.a897c785-2cef-4f87-9144-c715e5806f65" returned: 0 in 0.930s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:38 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.a897c785-2cef-4f87-9144-c715e5806f65 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:04:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.a897c785-2cef-4f87-9144-c715e5806f65 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:38 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.a897c785-2cef-4f87-9144-c715e5806f65 Jul 08 01:04:38 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:39 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.a897c785-2cef-4f87-9144-c715e5806f65" returned: 0 in 0.841s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:39 devstack sudo[92742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.info Jul 08 01:04:39 devstack sudo[92742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:40 devstack sudo[92742]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.info" returned: 0 in 0.836s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:40 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:04:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:40 devstack sudo[92750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.info Jul 08 01:04:40 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:41 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.info" returned: 0 in 0.753s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.855s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Flow 'volume_create_manager' (4a715fec-0a2d-42b4-87ab-1052b11ea356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922b7fc3-cd9a-4ccf-9533-1ffcae88f81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922b7fc3-cd9a-4ccf-9533-1ffcae88f81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-493070998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8c9794d-f2bd-4df8-a66e-81b4a0ee907a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c76f3f08a46d4827904073ceaad3275c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:04:41Z,use_quota=True,user_id='23b3481c38184e10aa0ad0a3e8457871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f779f19e-a6df-4a4b-92a9-ff6e7bbe6e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f779f19e-a6df-4a4b-92a9-ff6e7bbe6e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57073c31-b7db-4a9e-9d53-875cfb46143e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57073c31-b7db-4a9e-9d53-875cfb46143e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8c9794d-f2bd-4df8-a66e-81b4a0ee907a', 'volume_name': 'volume-f8c9794d-f2bd-4df8-a66e-81b4a0ee907a', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c62867c-63de-49c9-adb8-9800f9badba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c62867c-63de-49c9-adb8-9800f9badba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6b0b39-c279-4d99-9784-ab3ba7885e2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:41 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Volume f8c9794d-f2bd-4df8-a66e-81b4a0ee907a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8c9794d-f2bd-4df8-a66e-81b4a0ee907a', 'volume_size': 1} Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:04:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-493070998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8c9794d-f2bd-4df8-a66e-81b4a0ee907a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c76f3f08a46d4827904073ceaad3275c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:04:41Z,use_quota=True,user_id='23b3481c38184e10aa0ad0a3e8457871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Creating volume f8c9794d-f2bd-4df8-a66e-81b4a0ee907a {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:04:41 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:04:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f8c9794d-f2bd-4df8-a66e-81b4a0ee907a 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:41 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-a9727798-7442-41a8-8df2-e66d707c7712 tempest-GroupSnapshotsTest-1813075391 None] group_snapshot f0d212db-c4bd-43c6-9159-1404edbe1063: created successfully Jul 08 01:04:41 devstack sudo[92754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f8c9794d-f2bd-4df8-a66e-81b4a0ee907a 1073741824 Jul 08 01:04:41 devstack sudo[92754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:42 devstack sudo[92754]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:42 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] group_snapshot f0d212db-c4bd-43c6-9159-1404edbe1063: deleting Jul 08 01:04:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f8c9794d-f2bd-4df8-a66e-81b4a0ee907a 1073741824" returned: 0 in 1.123s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] group_snapshot f0d212db-c4bd-43c6-9159-1404edbe1063: deleting {{(pid=87123) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 01:04:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f8c9794d-f2bd-4df8-a66e-81b4a0ee907a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:42 devstack sudo[92760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f8c9794d-f2bd-4df8-a66e-81b4a0ee907a Jul 08 01:04:42 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "cinder-quobyte-0e2eafd1-89de-4030-8c43-1a7f09a29979" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:04:42 devstack sudo[92760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:42 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-0e2eafd1-89de-4030-8c43-1a7f09a29979" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:04:42 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "cinder-quobyte-9986fed4-943e-40ab-9610-400a72e0e97b" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:04:42 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-9986fed4-943e-40ab-9610-400a72e0e97b" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:04:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Deleting offline snapshot 9986fed4-943e-40ab-9610-400a72e0e97b of volume 0e2eafd1-89de-4030-8c43-1a7f09a29979 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:04:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] snapshot_file for this snap is: volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.9986fed4-943e-40ab-9610-400a72e0e97b {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:04:42 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab38ffd-7395-4f3a-a4f6-2e42592616d5]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:04:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.9986fed4-943e-40ab-9610-400a72e0e97b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:42 devstack sudo[92762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.9986fed4-943e-40ab-9610-400a72e0e97b Jul 08 01:04:42 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:43 devstack sudo[92760]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f8c9794d-f2bd-4df8-a66e-81b4a0ee907a" returned: 0 in 0.921s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] <== create_volume: return (2096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:04:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6b0b39-c279-4d99-9784-ab3ba7885e2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8c9794d-f2bd-4df8-a66e-81b4a0ee907a', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65fee3a2-a579-44e1-90d3-a35494aec240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:43 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Volume volume-f8c9794d-f2bd-4df8-a66e-81b4a0ee907a (f8c9794d-f2bd-4df8-a66e-81b4a0ee907a): created successfully Jul 08 01:04:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65fee3a2-a579-44e1-90d3-a35494aec240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Flow 'volume_create_manager' (4a715fec-0a2d-42b4-87ab-1052b11ea356) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:04:43 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-1898bec7-cf9a-42f2-86a3-da0eaac36078 tempest-VolumesListTestJSON-633380401 None] Created volume successfully. Jul 08 01:04:43 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.9986fed4-943e-40ab-9610-400a72e0e97b" returned: 0 in 1.010s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0e2eafd1-89de-4030-8c43-1a7f09a29979(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:04:43 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0074d0-9d5f-40d9-9fd1-82fdd2832265]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:04:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:43 devstack sudo[92770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979 Jul 08 01:04:43 devstack sudo[92770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:44 devstack sudo[92770]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979" returned: 0 in 0.938s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.9986fed4-943e-40ab-9610-400a72e0e97b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:44 devstack sudo[92775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.9986fed4-943e-40ab-9610-400a72e0e97b Jul 08 01:04:44 devstack sudo[92775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:04:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:04:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:04:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:44 devstack sudo[92777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:04:44 devstack sudo[92777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Flow 'volume_create_manager' (9ad9dd7f-4694-4562-801c-ce1e860c55c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31874c41-392c-47be-bea0-3b35a5ed666d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31874c41-392c-47be-bea0-3b35a5ed666d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2133167959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f5947b-7ab6-46a7-810c-e3da6655dd23,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c76f3f08a46d4827904073ceaad3275c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:04:45Z,use_quota=True,user_id='23b3481c38184e10aa0ad0a3e8457871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc78b71f-9301-46aa-841e-7a8fca823650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc78b71f-9301-46aa-841e-7a8fca823650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d45238d-265b-4c44-b1eb-5a66810e1ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d45238d-265b-4c44-b1eb-5a66810e1ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61f5947b-7ab6-46a7-810c-e3da6655dd23', 'volume_name': 'volume-61f5947b-7ab6-46a7-810c-e3da6655dd23', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789be818-d569-44f7-b70c-2471993b1947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (789be818-d569-44f7-b70c-2471993b1947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786fbb45-5a34-48e7-be11-2476a2029b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:45 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Volume 61f5947b-7ab6-46a7-810c-e3da6655dd23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61f5947b-7ab6-46a7-810c-e3da6655dd23', 'volume_size': 1} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:04:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2133167959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61f5947b-7ab6-46a7-810c-e3da6655dd23,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c76f3f08a46d4827904073ceaad3275c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:04:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:04:45Z,use_quota=True,user_id='23b3481c38184e10aa0ad0a3e8457871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Creating volume 61f5947b-7ab6-46a7-810c-e3da6655dd23 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:04:45 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61f5947b-7ab6-46a7-810c-e3da6655dd23 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:45 devstack sudo[92780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61f5947b-7ab6-46a7-810c-e3da6655dd23 1073741824 Jul 08 01:04:45 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:45 devstack sudo[92777]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.819s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 8 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:04:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:04:46 devstack sudo[92775]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.9986fed4-943e-40ab-9610-400a72e0e97b" returned: 0 in 1.582s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.9986fed4-943e-40ab-9610-400a72e0e97b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:46 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.9986fed4-943e-40ab-9610-400a72e0e97b Jul 08 01:04:46 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:47 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979.9986fed4-943e-40ab-9610-400a72e0e97b" returned: 0 in 0.821s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-9986fed4-943e-40ab-9610-400a72e0e97b" released by "_delete_snapshot" :: held 4.499s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:04:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-0e2eafd1-89de-4030-8c43-1a7f09a29979" released by "delete_snapshot" :: held 4.528s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:04:47 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61f5947b-7ab6-46a7-810c-e3da6655dd23 1073741824" returned: 0 in 1.568s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "cinder-quobyte-b436f1d7-59d9-4b2d-93d7-815f17b5cb43" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:04:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-b436f1d7-59d9-4b2d-93d7-815f17b5cb43" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:04:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "cinder-quobyte-a897c785-2cef-4f87-9144-c715e5806f65" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:04:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61f5947b-7ab6-46a7-810c-e3da6655dd23 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-a897c785-2cef-4f87-9144-c715e5806f65" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:04:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Deleting offline snapshot a897c785-2cef-4f87-9144-c715e5806f65 of volume b436f1d7-59d9-4b2d-93d7-815f17b5cb43 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:04:47 devstack sudo[92808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61f5947b-7ab6-46a7-810c-e3da6655dd23 Jul 08 01:04:47 devstack sudo[92808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] snapshot_file for this snap is: volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.a897c785-2cef-4f87-9144-c715e5806f65 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:04:47 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a3a7cb-eb4e-41bf-a762-722e0e5f8fc2]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:04:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.a897c785-2cef-4f87-9144-c715e5806f65 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:47 devstack sudo[92813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.a897c785-2cef-4f87-9144-c715e5806f65 Jul 08 01:04:47 devstack sudo[92813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:48 devstack sudo[92808]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61f5947b-7ab6-46a7-810c-e3da6655dd23" returned: 0 in 0.895s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] <== create_volume: return (2575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:04:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.581s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (786fbb45-5a34-48e7-be11-2476a2029b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61f5947b-7ab6-46a7-810c-e3da6655dd23', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962cdac4-2f63-433c-b628-5cddbd27b517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:48 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Volume volume-61f5947b-7ab6-46a7-810c-e3da6655dd23 (61f5947b-7ab6-46a7-810c-e3da6655dd23): created successfully Jul 08 01:04:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962cdac4-2f63-433c-b628-5cddbd27b517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Flow 'volume_create_manager' (9ad9dd7f-4694-4562-801c-ce1e860c55c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:04:48 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-55594f6d-3045-4ddd-b814-ebcc54051034 tempest-VolumesListTestJSON-633380401 None] Created volume successfully. Jul 08 01:04:48 devstack sudo[92813]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.a897c785-2cef-4f87-9144-c715e5806f65" returned: 0 in 1.001s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:04:48 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d0a992-4e74-41b4-8d61-b0fc4ca7d82c]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:04:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:48 devstack sudo[92822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43 Jul 08 01:04:48 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Flow 'volume_create_manager' (03a84244-c4dd-4dd9-afce-64f4c4029daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f715c639-6e46-452a-9685-aeaa3439719e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f715c639-6e46-452a-9685-aeaa3439719e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1097437876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=328eb2b8-c78d-453d-92b5-03e85eacfdc6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c76f3f08a46d4827904073ceaad3275c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:04:49Z,use_quota=True,user_id='23b3481c38184e10aa0ad0a3e8457871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d8cbd0-e047-4335-96f3-27b089f0b3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3d8cbd0-e047-4335-96f3-27b089f0b3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26f8904-ea6a-4f5b-a5dd-c92387cf2da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c26f8904-ea6a-4f5b-a5dd-c92387cf2da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '328eb2b8-c78d-453d-92b5-03e85eacfdc6', 'volume_name': 'volume-328eb2b8-c78d-453d-92b5-03e85eacfdc6', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:49 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9073737-2861-4666-ba5b-369e4762c950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9073737-2861-4666-ba5b-369e4762c950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f25056-ccba-498c-bc56-fb40255e70b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:49 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Volume 328eb2b8-c78d-453d-92b5-03e85eacfdc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-328eb2b8-c78d-453d-92b5-03e85eacfdc6', 'volume_size': 1} Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1097437876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=328eb2b8-c78d-453d-92b5-03e85eacfdc6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c76f3f08a46d4827904073ceaad3275c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:04:49Z,use_quota=True,user_id='23b3481c38184e10aa0ad0a3e8457871',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Creating volume 328eb2b8-c78d-453d-92b5-03e85eacfdc6 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:04:49 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-328eb2b8-c78d-453d-92b5-03e85eacfdc6 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43" returned: 0 in 0.977s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.a897c785-2cef-4f87-9144-c715e5806f65 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:49 devstack sudo[92827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-328eb2b8-c78d-453d-92b5-03e85eacfdc6 1073741824 Jul 08 01:04:49 devstack sudo[92827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:49 devstack sudo[92828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.a897c785-2cef-4f87-9144-c715e5806f65 Jul 08 01:04:49 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:50 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.a897c785-2cef-4f87-9144-c715e5806f65" returned: 0 in 0.873s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.a897c785-2cef-4f87-9144-c715e5806f65 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:50 devstack sudo[92839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.a897c785-2cef-4f87-9144-c715e5806f65 Jul 08 01:04:50 devstack sudo[92839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:50 devstack sudo[92827]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-328eb2b8-c78d-453d-92b5-03e85eacfdc6 1073741824" returned: 0 in 0.984s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-328eb2b8-c78d-453d-92b5-03e85eacfdc6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:50 devstack sudo[92841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-328eb2b8-c78d-453d-92b5-03e85eacfdc6 Jul 08 01:04:50 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:51 devstack sudo[92839]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43.a897c785-2cef-4f87-9144-c715e5806f65" returned: 0 in 0.736s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:51 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-a897c785-2cef-4f87-9144-c715e5806f65" released by "_delete_snapshot" :: held 3.765s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:04:51 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-b436f1d7-59d9-4b2d-93d7-815f17b5cb43" released by "delete_snapshot" :: held 3.826s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:04:51 devstack cinder-volume[87123]: WARNING cinder.quota [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1511900497 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1511900497, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:04:51 devstack cinder-volume[87123]: WARNING cinder.quota [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1511900497 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1511900497, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:04:51 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-328eb2b8-c78d-453d-92b5-03e85eacfdc6" returned: 0 in 0.776s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:04:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:04:51 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Created reservations ['9711ec2f-b377-4705-868e-e7355a5be166', 'b5ce95cf-2fea-4bcb-b05e-82153dd44f30', 'cade1f82-20a5-4321-9a7b-2a8586f742bb', '1a0be558-718b-4d25-a935-69878cc8a4b7'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:04:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67f25056-ccba-498c-bc56-fb40255e70b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-328eb2b8-c78d-453d-92b5-03e85eacfdc6', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eed76d6-2ce4-41b4-8f75-2911fc530483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:04:51 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Volume volume-328eb2b8-c78d-453d-92b5-03e85eacfdc6 (328eb2b8-c78d-453d-92b5-03e85eacfdc6): created successfully Jul 08 01:04:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eed76d6-2ce4-41b4-8f75-2911fc530483) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:04:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Flow 'volume_create_manager' (03a84244-c4dd-4dd9-afce-64f4c4029daf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:04:51 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-186d72d2-fbc5-4948-894d-f05c4068d63d tempest-VolumesListTestJSON-633380401 None] Created volume successfully. Jul 08 01:04:51 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] Created reservations ['10f1eedf-ac05-47bd-bce1-0abc0ddee526', '0316ea29-d263-443b-9e19-6a4f67790182', 'c306abdc-8f3f-414d-beea-4f46b08f3acc', 'e6cb3a3f-d3f9-4636-8869-6e210c9b09be'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:04:51 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-4de3ad4f-fefc-4384-897d-e0891981ce3a tempest-GroupSnapshotsTest-1813075391 None] group_snapshot f0d212db-c4bd-43c6-9159-1404edbe1063: deleted successfully Jul 08 01:04:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "cinder-quobyte-0e2eafd1-89de-4030-8c43-1a7f09a29979" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:04:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-0e2eafd1-89de-4030-8c43-1a7f09a29979" acquired by "delete_volume" :: waited 0.046s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:04:52 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[a008fa59-ca2b-4cb6-aab1-66040e78aff9]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:04:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:52 devstack sudo[92887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979 Jul 08 01:04:52 devstack sudo[92887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:54 devstack sudo[92887]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979" returned: 0 in 2.005s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:54 devstack sudo[92935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979 Jul 08 01:04:54 devstack sudo[92935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:55 devstack sudo[92935]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0e2eafd1-89de-4030-8c43-1a7f09a29979" returned: 0 in 1.077s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-0e2eafd1-89de-4030-8c43-1a7f09a29979" released by "delete_volume" :: held 3.248s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:04:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "cinder-quobyte-b436f1d7-59d9-4b2d-93d7-815f17b5cb43" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:04:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-b436f1d7-59d9-4b2d-93d7-815f17b5cb43" acquired by "delete_volume" :: waited 0.042s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:04:55 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[2354d8be-386e-47e8-b427-56f6875f1d05]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:04:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:56 devstack sudo[92942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43 Jul 08 01:04:56 devstack sudo[92942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:56 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=95,cinder:UPDATE=102,cinder:INSERT=24,cinder:DELETE=9 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:04:56 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=93,cinder:UPDATE=108,cinder:INSERT=24,cinder:DELETE=3 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:04:57 devstack sudo[92942]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43" returned: 0 in 1.325s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:57 devstack sudo[92955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43 Jul 08 01:04:57 devstack sudo[92955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3dc4e1bd-8b8e-46a5-8b67-1e141b146b20 tempest-VolumesListTestJSON-633380401 None] Acquiring lock "cinder-328eb2b8-c78d-453d-92b5-03e85eacfdc6-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:04:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3dc4e1bd-8b8e-46a5-8b67-1e141b146b20 tempest-VolumesListTestJSON-633380401 None] Lock "cinder-328eb2b8-c78d-453d-92b5-03e85eacfdc6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:04:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3dc4e1bd-8b8e-46a5-8b67-1e141b146b20 tempest-VolumesListTestJSON-633380401 None] Acquiring lock "cinder-quobyte-328eb2b8-c78d-453d-92b5-03e85eacfdc6" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:04:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3dc4e1bd-8b8e-46a5-8b67-1e141b146b20 tempest-VolumesListTestJSON-633380401 None] Lock "cinder-quobyte-328eb2b8-c78d-453d-92b5-03e85eacfdc6" acquired by "delete_volume" :: waited 0.027s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:04:57 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0828ad3-fbba-480f-b570-43c8e9ed1b68]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:04:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3dc4e1bd-8b8e-46a5-8b67-1e141b146b20 tempest-VolumesListTestJSON-633380401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-328eb2b8-c78d-453d-92b5-03e85eacfdc6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:57 devstack sudo[92957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-328eb2b8-c78d-453d-92b5-03e85eacfdc6 Jul 08 01:04:57 devstack sudo[92957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:58 devstack sudo[92955]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b436f1d7-59d9-4b2d-93d7-815f17b5cb43" returned: 0 in 1.775s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-b436f1d7-59d9-4b2d-93d7-815f17b5cb43" released by "delete_volume" :: held 3.286s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:04:59 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] Created reservations ['72d6bd1b-bd05-44d5-9c8e-62e09ddf63e3'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:04:59 devstack sudo[92957]: pam_unix(sudo:session): session closed for user root Jul 08 01:04:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3dc4e1bd-8b8e-46a5-8b67-1e141b146b20 tempest-VolumesListTestJSON-633380401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-328eb2b8-c78d-453d-92b5-03e85eacfdc6" returned: 0 in 1.834s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:04:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3dc4e1bd-8b8e-46a5-8b67-1e141b146b20 tempest-VolumesListTestJSON-633380401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-328eb2b8-c78d-453d-92b5-03e85eacfdc6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:04:59 devstack sudo[92999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-328eb2b8-c78d-453d-92b5-03e85eacfdc6 Jul 08 01:04:59 devstack sudo[92999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:04:59 devstack cinder-volume[87123]: WARNING cinder.quota [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1511900497 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1511900497, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:04:59 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] Created reservations ['a67abf04-be60-43f7-aa5d-dd4b1b06f2c6', '3c2dd61f-a5cc-4f96-bd65-6bf3de7993ee', 'a52ea0c0-a56c-4688-b1ff-ab28d17a8dd5', '1447f86a-26f5-40f6-aeed-9219fc955c69'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:04:59 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] Created reservations ['640b50a8-fbb8-4592-9d3f-09e0f2e3cefd', '3b7468bb-57ff-490b-a1ba-9aae68b0c08d', '7b49e471-57f9-455c-80a4-ba8bce37c75d', 'b40eebe1-96b6-4fd3-a18d-7018daa958ff'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:05:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:05:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:05:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:00 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:05:00 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:01 devstack sudo[92999]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3dc4e1bd-8b8e-46a5-8b67-1e141b146b20 tempest-VolumesListTestJSON-633380401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-328eb2b8-c78d-453d-92b5-03e85eacfdc6" returned: 0 in 1.927s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:01 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3dc4e1bd-8b8e-46a5-8b67-1e141b146b20 tempest-VolumesListTestJSON-633380401 None] Lock "cinder-quobyte-328eb2b8-c78d-453d-92b5-03e85eacfdc6" released by "delete_volume" :: held 3.887s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:05:01 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-3dc4e1bd-8b8e-46a5-8b67-1e141b146b20 tempest-VolumesListTestJSON-633380401 None] Created reservations ['0090c510-35da-430b-8a88-55534c6a7e02', '8016980a-8a5f-4c4f-83fc-961fb358b291', '36af16c9-3e61-403d-86d8-9aa280434edd', '03051c29-896e-47fd-8ab2-c96cfcf76c52'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:05:01 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-53c8e2fa-6a8b-40e2-a934-d7e65ec8865d tempest-GroupSnapshotsTest-1813075391 None] Group tempest-GroupSnapshotsTest-Group-132230054: creating Jul 08 01:05:01 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-53c8e2fa-6a8b-40e2-a934-d7e65ec8865d tempest-GroupSnapshotsTest-1813075391 None] Group tempest-GroupSnapshotsTest-Group-132230054: created successfully Jul 08 01:05:01 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-53c8e2fa-6a8b-40e2-a934-d7e65ec8865d tempest-GroupSnapshotsTest-1813075391 None] Create group completed successfully. Jul 08 01:05:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3dc4e1bd-8b8e-46a5-8b67-1e141b146b20 tempest-VolumesListTestJSON-633380401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3dc4e1bd-8b8e-46a5-8b67-1e141b146b20 tempest-VolumesListTestJSON-633380401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3dc4e1bd-8b8e-46a5-8b67-1e141b146b20 tempest-VolumesListTestJSON-633380401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:05:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3dc4e1bd-8b8e-46a5-8b67-1e141b146b20 tempest-VolumesListTestJSON-633380401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:05:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3dc4e1bd-8b8e-46a5-8b67-1e141b146b20 tempest-VolumesListTestJSON-633380401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3dc4e1bd-8b8e-46a5-8b67-1e141b146b20 tempest-VolumesListTestJSON-633380401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:01 devstack sudo[93036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:05:01 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:02 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.993s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:02 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:05:02 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-c03edd49-b6b8-41d9-a086-98fe64539bc8 tempest-GroupSnapshotsTest-1813075391 None] Delete group completed successfully. Jul 08 01:05:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-52462eb3-ac92-4cc2-ad1d-2dd7085670fc tempest-VolumesListTestJSON-633380401 None] Acquiring lock "cinder-61f5947b-7ab6-46a7-810c-e3da6655dd23-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:05:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-52462eb3-ac92-4cc2-ad1d-2dd7085670fc tempest-VolumesListTestJSON-633380401 None] Lock "cinder-61f5947b-7ab6-46a7-810c-e3da6655dd23-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:05:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-52462eb3-ac92-4cc2-ad1d-2dd7085670fc tempest-VolumesListTestJSON-633380401 None] Acquiring lock "cinder-quobyte-61f5947b-7ab6-46a7-810c-e3da6655dd23" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:05:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-52462eb3-ac92-4cc2-ad1d-2dd7085670fc tempest-VolumesListTestJSON-633380401 None] Lock "cinder-quobyte-61f5947b-7ab6-46a7-810c-e3da6655dd23" acquired by "delete_volume" :: waited 0.031s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:05:02 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[613b1ece-bea1-49c4-8a7b-0887fa8c6a8a]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-52462eb3-ac92-4cc2-ad1d-2dd7085670fc tempest-VolumesListTestJSON-633380401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61f5947b-7ab6-46a7-810c-e3da6655dd23 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:02 devstack sudo[93045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61f5947b-7ab6-46a7-810c-e3da6655dd23 Jul 08 01:05:02 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:03 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3dc4e1bd-8b8e-46a5-8b67-1e141b146b20 tempest-VolumesListTestJSON-633380401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.868s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:03 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-3dc4e1bd-8b8e-46a5-8b67-1e141b146b20 tempest-VolumesListTestJSON-633380401 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:05:03 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-3dc4e1bd-8b8e-46a5-8b67-1e141b146b20 tempest-VolumesListTestJSON-633380401 None] Deleted volume successfully. Jul 08 01:05:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3dc4e1bd-8b8e-46a5-8b67-1e141b146b20 tempest-VolumesListTestJSON-633380401 None] Lock "cinder-328eb2b8-c78d-453d-92b5-03e85eacfdc6-delete_volume" released by "delete_volume" :: held 6.403s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:05:03 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-52462eb3-ac92-4cc2-ad1d-2dd7085670fc tempest-VolumesListTestJSON-633380401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61f5947b-7ab6-46a7-810c-e3da6655dd23" returned: 0 in 1.503s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-52462eb3-ac92-4cc2-ad1d-2dd7085670fc tempest-VolumesListTestJSON-633380401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61f5947b-7ab6-46a7-810c-e3da6655dd23 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:04 devstack sudo[93051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61f5947b-7ab6-46a7-810c-e3da6655dd23 Jul 08 01:05:04 devstack sudo[93051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:04 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:05:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Flow 'volume_create_manager' (87da15ef-7e6f-4bee-8f99-e1ab8d2c055b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:05:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c9ae85-57b0-4db1-aa70-b69ccb15e7ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41c9ae85-57b0-4db1-aa70-b69ccb15e7ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1001631758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d117aa02-b330-4978-ab38-d6cdc4a9b022,host='devstack@QuobyteHD#QuobyteHD',id=1f2dad09-de15-419f-9ae1-043fb38025c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735fa01232f0474fb478aed2dd8f744a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:05:04Z,use_quota=True,user_id='8a1f6bb8f1be45139832c6fd53993dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1c843de-3f0f-4f3c-a350-60467a1d66b0),volume_type_id=b1c843de-3f0f-4f3c-a350-60467a1d66b0)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d43796-0208-4bf7-b4a2-f711b91f18d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22d43796-0208-4bf7-b4a2-f711b91f18d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18867262-083f-4eb2-84b6-90caccad5718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18867262-083f-4eb2-84b6-90caccad5718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f2dad09-de15-419f-9ae1-043fb38025c0', 'volume_name': 'volume-1f2dad09-de15-419f-9ae1-043fb38025c0', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac082ec-eff4-4ac2-9efa-b9331e71c5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ac082ec-eff4-4ac2-9efa-b9331e71c5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fdc230-6cec-416e-aec5-4a406aafbb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:04 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Volume 1f2dad09-de15-419f-9ae1-043fb38025c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f2dad09-de15-419f-9ae1-043fb38025c0', 'volume_size': 1} Jul 08 01:05:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:04 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d117aa02-b330-4978-ab38-d6cdc4a9b022,created_at=2026-07-07T23:05:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1001631758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d117aa02-b330-4978-ab38-d6cdc4a9b022,host='devstack@QuobyteHD#QuobyteHD',id=1f2dad09-de15-419f-9ae1-043fb38025c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='735fa01232f0474fb478aed2dd8f744a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:05:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:05:04Z,use_quota=True,user_id='8a1f6bb8f1be45139832c6fd53993dc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b1c843de-3f0f-4f3c-a350-60467a1d66b0),volume_type_id=b1c843de-3f0f-4f3c-a350-60467a1d66b0)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:05:04 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Creating volume 1f2dad09-de15-419f-9ae1-043fb38025c0 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:05:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:04 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:05:04 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:05:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:04 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:05:04 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:05:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:04 devstack sudo[93053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0 1073741824 Jul 08 01:05:04 devstack sudo[93053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:05 devstack sudo[93051]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-52462eb3-ac92-4cc2-ad1d-2dd7085670fc tempest-VolumesListTestJSON-633380401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61f5947b-7ab6-46a7-810c-e3da6655dd23" returned: 0 in 1.769s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:05 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-52462eb3-ac92-4cc2-ad1d-2dd7085670fc tempest-VolumesListTestJSON-633380401 None] Lock "cinder-quobyte-61f5947b-7ab6-46a7-810c-e3da6655dd23" released by "delete_volume" :: held 3.349s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:05:06 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-52462eb3-ac92-4cc2-ad1d-2dd7085670fc tempest-VolumesListTestJSON-633380401 None] Created reservations ['f6415c57-b30c-43e5-a0c3-3058d32f9efd', '0aa023a8-b771-4dda-8295-99592ca53fd3', 'ceb9f5e8-55d8-41a1-99c5-8fd902360f37', '2f69daa6-e01e-4114-9d77-15468006f498'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:05:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-52462eb3-ac92-4cc2-ad1d-2dd7085670fc tempest-VolumesListTestJSON-633380401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-52462eb3-ac92-4cc2-ad1d-2dd7085670fc tempest-VolumesListTestJSON-633380401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:06 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-52462eb3-ac92-4cc2-ad1d-2dd7085670fc tempest-VolumesListTestJSON-633380401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:05:06 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-52462eb3-ac92-4cc2-ad1d-2dd7085670fc tempest-VolumesListTestJSON-633380401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:05:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-52462eb3-ac92-4cc2-ad1d-2dd7085670fc tempest-VolumesListTestJSON-633380401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-52462eb3-ac92-4cc2-ad1d-2dd7085670fc tempest-VolumesListTestJSON-633380401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:06 devstack sudo[93060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:05:06 devstack sudo[93060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:06 devstack sudo[93053]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0 1073741824" returned: 0 in 1.942s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:06 devstack sudo[93062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0 Jul 08 01:05:06 devstack sudo[93062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:07 devstack sudo[93060]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-52462eb3-ac92-4cc2-ad1d-2dd7085670fc tempest-VolumesListTestJSON-633380401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.976s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:07 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-52462eb3-ac92-4cc2-ad1d-2dd7085670fc tempest-VolumesListTestJSON-633380401 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:05:07 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-52462eb3-ac92-4cc2-ad1d-2dd7085670fc tempest-VolumesListTestJSON-633380401 None] Deleted volume successfully. Jul 08 01:05:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-52462eb3-ac92-4cc2-ad1d-2dd7085670fc tempest-VolumesListTestJSON-633380401 None] Lock "cinder-61f5947b-7ab6-46a7-810c-e3da6655dd23-delete_volume" released by "delete_volume" :: held 4.901s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:05:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-53870379-bda2-4165-82c8-6010f5fab7d0 tempest-VolumesListTestJSON-633380401 None] Acquiring lock "cinder-f8c9794d-f2bd-4df8-a66e-81b4a0ee907a-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:05:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-53870379-bda2-4165-82c8-6010f5fab7d0 tempest-VolumesListTestJSON-633380401 None] Lock "cinder-f8c9794d-f2bd-4df8-a66e-81b4a0ee907a-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:05:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-53870379-bda2-4165-82c8-6010f5fab7d0 tempest-VolumesListTestJSON-633380401 None] Acquiring lock "cinder-quobyte-f8c9794d-f2bd-4df8-a66e-81b4a0ee907a" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:05:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-53870379-bda2-4165-82c8-6010f5fab7d0 tempest-VolumesListTestJSON-633380401 None] Lock "cinder-quobyte-f8c9794d-f2bd-4df8-a66e-81b4a0ee907a" acquired by "delete_volume" :: waited 0.045s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:05:07 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea21e2b9-94cc-4e7a-83f8-37ca658a9c87]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-53870379-bda2-4165-82c8-6010f5fab7d0 tempest-VolumesListTestJSON-633380401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f8c9794d-f2bd-4df8-a66e-81b4a0ee907a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:08 devstack sudo[93077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f8c9794d-f2bd-4df8-a66e-81b4a0ee907a Jul 08 01:05:08 devstack sudo[93077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:08 devstack sudo[93062]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0" returned: 0 in 2.038s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:08 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] <== create_volume: return (4065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:05:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.069s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01fdc230-6cec-416e-aec5-4a406aafbb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f2dad09-de15-419f-9ae1-043fb38025c0', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (059f76d4-8276-4283-96ce-29d2c91179d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:08 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Volume volume-1f2dad09-de15-419f-9ae1-043fb38025c0 (1f2dad09-de15-419f-9ae1-043fb38025c0): created successfully Jul 08 01:05:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (059f76d4-8276-4283-96ce-29d2c91179d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Flow 'volume_create_manager' (87da15ef-7e6f-4bee-8f99-e1ab8d2c055b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:05:08 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-bab10bdf-74c4-48bd-835c-5937f5db8605 tempest-GroupSnapshotsTest-1813075391 None] Created volume successfully. Jul 08 01:05:09 devstack sudo[93077]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-53870379-bda2-4165-82c8-6010f5fab7d0 tempest-VolumesListTestJSON-633380401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f8c9794d-f2bd-4df8-a66e-81b4a0ee907a" returned: 0 in 1.686s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-53870379-bda2-4165-82c8-6010f5fab7d0 tempest-VolumesListTestJSON-633380401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f8c9794d-f2bd-4df8-a66e-81b4a0ee907a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:09 devstack sudo[93112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f8c9794d-f2bd-4df8-a66e-81b4a0ee907a Jul 08 01:05:09 devstack sudo[93112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:10 devstack sudo[93112]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-53870379-bda2-4165-82c8-6010f5fab7d0 tempest-VolumesListTestJSON-633380401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f8c9794d-f2bd-4df8-a66e-81b4a0ee907a" returned: 0 in 0.868s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-53870379-bda2-4165-82c8-6010f5fab7d0 tempest-VolumesListTestJSON-633380401 None] Lock "cinder-quobyte-f8c9794d-f2bd-4df8-a66e-81b4a0ee907a" released by "delete_volume" :: held 2.644s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:05:10 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-53870379-bda2-4165-82c8-6010f5fab7d0 tempest-VolumesListTestJSON-633380401 None] Created reservations ['ed7aa22f-adf1-4089-968b-f559dcf09724', '0ba58367-9c21-48e5-846c-d87e135d00da', 'd0a4aa13-fafd-40e6-a0bb-ce95a8d528ad', '538ba29a-70b2-498d-8ee8-475e881d9d59'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:05:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-53870379-bda2-4165-82c8-6010f5fab7d0 tempest-VolumesListTestJSON-633380401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-53870379-bda2-4165-82c8-6010f5fab7d0 tempest-VolumesListTestJSON-633380401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:10 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-53870379-bda2-4165-82c8-6010f5fab7d0 tempest-VolumesListTestJSON-633380401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:05:10 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-53870379-bda2-4165-82c8-6010f5fab7d0 tempest-VolumesListTestJSON-633380401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:05:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-53870379-bda2-4165-82c8-6010f5fab7d0 tempest-VolumesListTestJSON-633380401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-53870379-bda2-4165-82c8-6010f5fab7d0 tempest-VolumesListTestJSON-633380401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:10 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b0b78c9f-4fd1-4e85-8710-c18f4f128393 tempest-GroupSnapshotsTest-1813075391 None] GroupSnapshot 138dc0f4-7ad1-436d-a3aa-2b30b76e4305: creating. Jul 08 01:05:10 devstack sudo[93155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:05:10 devstack sudo[93155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b0b78c9f-4fd1-4e85-8710-c18f4f128393 tempest-GroupSnapshotsTest-1813075391 None] Group snapshot 138dc0f4-7ad1-436d-a3aa-2b30b76e4305: creating. {{(pid=87123) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 01:05:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b0b78c9f-4fd1-4e85-8710-c18f4f128393 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b0b78c9f-4fd1-4e85-8710-c18f4f128393 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:10 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-b0b78c9f-4fd1-4e85-8710-c18f4f128393 tempest-GroupSnapshotsTest-1813075391 None] Creating offline snapshot b5af538f-e8df-40e9-9fc4-5a1f0a0ce241 of volume 1f2dad09-de15-419f-9ae1-043fb38025c0 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:05:10 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d977274b-5057-4c39-9b68-eb566e2a247e]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0b78c9f-4fd1-4e85-8710-c18f4f128393 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:10 devstack sudo[93157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0 Jul 08 01:05:10 devstack sudo[93157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:11 devstack sudo[93155]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-53870379-bda2-4165-82c8-6010f5fab7d0 tempest-VolumesListTestJSON-633380401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.739s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:11 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-53870379-bda2-4165-82c8-6010f5fab7d0 tempest-VolumesListTestJSON-633380401 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:05:11 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-53870379-bda2-4165-82c8-6010f5fab7d0 tempest-VolumesListTestJSON-633380401 None] Deleted volume successfully. Jul 08 01:05:11 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-53870379-bda2-4165-82c8-6010f5fab7d0 tempest-VolumesListTestJSON-633380401 None] Lock "cinder-f8c9794d-f2bd-4df8-a66e-81b4a0ee907a-delete_volume" released by "delete_volume" :: held 3.791s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:05:11 devstack sudo[93157]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0b78c9f-4fd1-4e85-8710-c18f4f128393 tempest-GroupSnapshotsTest-1813075391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0" returned: 0 in 1.010s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0b78c9f-4fd1-4e85-8710-c18f4f128393 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.b5af538f-e8df-40e9-9fc4-5a1f0a0ce241 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:11 devstack sudo[93163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.b5af538f-e8df-40e9-9fc4-5a1f0a0ce241 1G Jul 08 01:05:11 devstack sudo[93163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:12 devstack sudo[93163]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0b78c9f-4fd1-4e85-8710-c18f4f128393 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.b5af538f-e8df-40e9-9fc4-5a1f0a0ce241 1G" returned: 0 in 1.240s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0b78c9f-4fd1-4e85-8710-c18f4f128393 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f2dad09-de15-419f-9ae1-043fb38025c0 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.b5af538f-e8df-40e9-9fc4-5a1f0a0ce241 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:13 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f2dad09-de15-419f-9ae1-043fb38025c0 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.b5af538f-e8df-40e9-9fc4-5a1f0a0ce241 Jul 08 01:05:13 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:13 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0b78c9f-4fd1-4e85-8710-c18f4f128393 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f2dad09-de15-419f-9ae1-043fb38025c0 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.b5af538f-e8df-40e9-9fc4-5a1f0a0ce241" returned: 0 in 0.900s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:13 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-b0b78c9f-4fd1-4e85-8710-c18f4f128393 tempest-GroupSnapshotsTest-1813075391 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.b5af538f-e8df-40e9-9fc4-5a1f0a0ce241 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:05:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0b78c9f-4fd1-4e85-8710-c18f4f128393 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.b5af538f-e8df-40e9-9fc4-5a1f0a0ce241 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:13 devstack sudo[93178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.b5af538f-e8df-40e9-9fc4-5a1f0a0ce241 Jul 08 01:05:13 devstack sudo[93178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:14 devstack sudo[93178]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0b78c9f-4fd1-4e85-8710-c18f4f128393 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.b5af538f-e8df-40e9-9fc4-5a1f0a0ce241" returned: 0 in 0.741s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0b78c9f-4fd1-4e85-8710-c18f4f128393 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:14 devstack sudo[93181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.info Jul 08 01:05:14 devstack sudo[93181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:15 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:05:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Flow 'volume_create_manager' (10cd57c9-76b7-4ddd-a9ed-53977f846ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:05:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaea3708-0ddd-4ffc-a5a5-5a3d2c8e9777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaea3708-0ddd-4ffc-a5a5-5a3d2c8e9777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1337157328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60bddbaf-7e35-4cfd-beb8-9bb66f677343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c5deb5aa6e9486e8d833fecb05a7522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:05:15Z,use_quota=True,user_id='da938765297e454e8c573c7db1fda868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e35963-c4b5-4a4a-a7ce-0cecb85b7c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e35963-c4b5-4a4a-a7ce-0cecb85b7c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6cd512-f152-413a-90a4-5ff3b679799a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa6cd512-f152-413a-90a4-5ff3b679799a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60bddbaf-7e35-4cfd-beb8-9bb66f677343', 'volume_name': 'volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6522fded-0e0a-4bec-8c05-7f6ff2c27273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6522fded-0e0a-4bec-8c05-7f6ff2c27273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5cd2168-6daa-4b72-91d2-9cda4e9e7b04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:15 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Volume 60bddbaf-7e35-4cfd-beb8-9bb66f677343: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343', 'volume_size': 1} Jul 08 01:05:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:15 devstack sudo[93181]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0b78c9f-4fd1-4e85-8710-c18f4f128393 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.info" returned: 0 in 0.843s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:15 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-b0b78c9f-4fd1-4e85-8710-c18f4f128393 tempest-GroupSnapshotsTest-1813075391 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:05:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0b78c9f-4fd1-4e85-8710-c18f4f128393 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:15 devstack sudo[93184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.info Jul 08 01:05:15 devstack sudo[93184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:16 devstack sudo[93184]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0b78c9f-4fd1-4e85-8710-c18f4f128393 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.info" returned: 0 in 0.718s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b0b78c9f-4fd1-4e85-8710-c18f4f128393 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.558s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.031s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1337157328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60bddbaf-7e35-4cfd-beb8-9bb66f677343,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c5deb5aa6e9486e8d833fecb05a7522',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:05:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:05:15Z,use_quota=True,user_id='da938765297e454e8c573c7db1fda868',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:05:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Creating volume 60bddbaf-7e35-4cfd-beb8-9bb66f677343 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:05:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:05:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:05:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:05:16 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:05:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:16 devstack sudo[93187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343 1073741824 Jul 08 01:05:16 devstack sudo[93187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:16 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b0b78c9f-4fd1-4e85-8710-c18f4f128393 tempest-GroupSnapshotsTest-1813075391 None] group_snapshot 138dc0f4-7ad1-436d-a3aa-2b30b76e4305: created successfully Jul 08 01:05:17 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] group_snapshot 138dc0f4-7ad1-436d-a3aa-2b30b76e4305: deleting Jul 08 01:05:17 devstack sudo[93187]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343 1073741824" returned: 0 in 1.139s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] group_snapshot 138dc0f4-7ad1-436d-a3aa-2b30b76e4305: deleting {{(pid=87123) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 01:05:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "cinder-quobyte-1f2dad09-de15-419f-9ae1-043fb38025c0" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:05:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-1f2dad09-de15-419f-9ae1-043fb38025c0" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:05:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "cinder-quobyte-b5af538f-e8df-40e9-9fc4-5a1f0a0ce241" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:05:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-b5af538f-e8df-40e9-9fc4-5a1f0a0ce241" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:05:17 devstack sudo[93208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343 Jul 08 01:05:17 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] Deleting offline snapshot b5af538f-e8df-40e9-9fc4-5a1f0a0ce241 of volume 1f2dad09-de15-419f-9ae1-043fb38025c0 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:05:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] snapshot_file for this snap is: volume-1f2dad09-de15-419f-9ae1-043fb38025c0.b5af538f-e8df-40e9-9fc4-5a1f0a0ce241 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:05:17 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b643c7-0be8-45ff-87ea-3030fbc181c7]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.b5af538f-e8df-40e9-9fc4-5a1f0a0ce241 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:17 devstack sudo[93210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.b5af538f-e8df-40e9-9fc4-5a1f0a0ce241 Jul 08 01:05:17 devstack sudo[93210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:18 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343" returned: 0 in 0.753s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] <== create_volume: return (1969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:05:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5cd2168-6daa-4b72-91d2-9cda4e9e7b04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e8ae4b-bd5b-4bd2-a56b-3349723f5221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:18 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Volume volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343 (60bddbaf-7e35-4cfd-beb8-9bb66f677343): created successfully Jul 08 01:05:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72e8ae4b-bd5b-4bd2-a56b-3349723f5221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Flow 'volume_create_manager' (10cd57c9-76b7-4ddd-a9ed-53977f846ec4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:05:18 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f92ec28c-246f-429a-aadb-a34c77c1a83c tempest-VolumesSnapshotListTestJSON-228850654 None] Created volume successfully. Jul 08 01:05:18 devstack sudo[93210]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.b5af538f-e8df-40e9-9fc4-5a1f0a0ce241" returned: 0 in 0.955s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f2dad09-de15-419f-9ae1-043fb38025c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:05:18 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9a81b9-ad45-4024-8427-f3a151d6d042]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:18 devstack sudo[93216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0 Jul 08 01:05:18 devstack sudo[93216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:19 devstack sudo[93216]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0" returned: 0 in 0.880s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.b5af538f-e8df-40e9-9fc4-5a1f0a0ce241 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:19 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.b5af538f-e8df-40e9-9fc4-5a1f0a0ce241 Jul 08 01:05:19 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3b728da2-55ed-4caa-96e2-9d7a17829a6b tempest-VolumesSnapshotListTestJSON-228850654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3b728da2-55ed-4caa-96e2-9d7a17829a6b tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-3b728da2-55ed-4caa-96e2-9d7a17829a6b tempest-VolumesSnapshotListTestJSON-228850654 None] Creating offline snapshot b0c57e14-e4c7-4b07-8fbe-ce74016373eb of volume 60bddbaf-7e35-4cfd-beb8-9bb66f677343 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:05:19 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c820c67-7000-43bf-893c-7a281f027c85]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3b728da2-55ed-4caa-96e2-9d7a17829a6b tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:19 devstack sudo[93227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343 Jul 08 01:05:19 devstack sudo[93227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:20 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.b5af538f-e8df-40e9-9fc4-5a1f0a0ce241" returned: 0 in 0.912s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.b5af538f-e8df-40e9-9fc4-5a1f0a0ce241 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:20 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.b5af538f-e8df-40e9-9fc4-5a1f0a0ce241 Jul 08 01:05:20 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:20 devstack sudo[93227]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3b728da2-55ed-4caa-96e2-9d7a17829a6b tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343" returned: 0 in 0.923s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3b728da2-55ed-4caa-96e2-9d7a17829a6b tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:20 devstack sudo[93242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb 1G Jul 08 01:05:20 devstack sudo[93242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:21 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0.b5af538f-e8df-40e9-9fc4-5a1f0a0ce241" returned: 0 in 0.827s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-b5af538f-e8df-40e9-9fc4-5a1f0a0ce241" released by "_delete_snapshot" :: held 3.697s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:05:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-1f2dad09-de15-419f-9ae1-043fb38025c0" released by "delete_snapshot" :: held 3.736s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:05:21 devstack cinder-volume[87123]: WARNING cinder.quota [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-127651775 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-127651775, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:05:21 devstack cinder-volume[87123]: WARNING cinder.quota [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-127651775 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-127651775, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:05:21 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] Created reservations ['6cd51e72-3813-4a93-9335-6c31158a1b4e', '86c11514-5794-48e0-89f2-2ab38409589e', '59d68be8-eb29-4842-ab36-eaf99c271cce', '87e47359-af52-46a8-b9ae-1200e426d391'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:05:21 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-6b3de002-1f59-482b-b9b4-323d7e7ecfc3 tempest-GroupSnapshotsTest-1813075391 None] group_snapshot 138dc0f4-7ad1-436d-a3aa-2b30b76e4305: deleted successfully Jul 08 01:05:21 devstack sudo[93242]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3b728da2-55ed-4caa-96e2-9d7a17829a6b tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb 1G" returned: 0 in 0.974s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3b728da2-55ed-4caa-96e2-9d7a17829a6b tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:21 devstack sudo[93248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb Jul 08 01:05:21 devstack sudo[93248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1e2e7c35-1bde-44d8-8606-f6ee3f143662 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "cinder-quobyte-1f2dad09-de15-419f-9ae1-043fb38025c0" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:05:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1e2e7c35-1bde-44d8-8606-f6ee3f143662 tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-1f2dad09-de15-419f-9ae1-043fb38025c0" acquired by "delete_volume" :: waited 0.038s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:05:22 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c465da8-0da3-48c5-b5f8-6354e185b409]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1e2e7c35-1bde-44d8-8606-f6ee3f143662 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:22 devstack sudo[93248]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3b728da2-55ed-4caa-96e2-9d7a17829a6b tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb" returned: 0 in 0.873s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:22 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-3b728da2-55ed-4caa-96e2-9d7a17829a6b tempest-VolumesSnapshotListTestJSON-228850654 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb is being set with open permissions: ugo+rw Jul 08 01:05:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3b728da2-55ed-4caa-96e2-9d7a17829a6b tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:22 devstack sudo[93258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0 Jul 08 01:05:22 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:22 devstack sudo[93260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb Jul 08 01:05:22 devstack sudo[93260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:22 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:05:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Flow 'volume_create_manager' (33e0a69c-0705-496a-8df4-9fd5ccc36810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:05:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c982e8-8452-4b3e-8ded-e24351f40af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c982e8-8452-4b3e-8ded-e24351f40af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-240231889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5faae36d-d2ef-45ce-9276-e51d68821896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd62ddc1bc3440f9399d30f12c1ac69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:05:23Z,use_quota=True,user_id='2d8ce5452ccb411592fbdbc080b8a1ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5cd2c5b-1b30-4097-921a-d0c9f2d4229c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5cd2c5b-1b30-4097-921a-d0c9f2d4229c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26de927a-a2cc-4cae-9d6d-f77d575ba65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26de927a-a2cc-4cae-9d6d-f77d575ba65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5faae36d-d2ef-45ce-9276-e51d68821896', 'volume_name': 'volume-5faae36d-d2ef-45ce-9276-e51d68821896', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dd0e2bf-2bce-4220-902e-3799624f2c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2dd0e2bf-2bce-4220-902e-3799624f2c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9645099e-6dad-4dd1-9f74-2cc4c5609498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:23 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Volume 5faae36d-d2ef-45ce-9276-e51d68821896: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5faae36d-d2ef-45ce-9276-e51d68821896', 'volume_size': 1} Jul 08 01:05:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:23 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1e2e7c35-1bde-44d8-8606-f6ee3f143662 tempest-GroupSnapshotsTest-1813075391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0" returned: 0 in 1.000s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1e2e7c35-1bde-44d8-8606-f6ee3f143662 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:23 devstack sudo[93267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0 Jul 08 01:05:23 devstack sudo[93267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:23 devstack sudo[93260]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3b728da2-55ed-4caa-96e2-9d7a17829a6b tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb" returned: 0 in 0.843s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3b728da2-55ed-4caa-96e2-9d7a17829a6b tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:23 devstack sudo[93269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.info Jul 08 01:05:23 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:24 devstack sudo[93267]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1e2e7c35-1bde-44d8-8606-f6ee3f143662 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1f2dad09-de15-419f-9ae1-043fb38025c0" returned: 0 in 0.802s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1e2e7c35-1bde-44d8-8606-f6ee3f143662 tempest-GroupSnapshotsTest-1813075391 None] Lock "cinder-quobyte-1f2dad09-de15-419f-9ae1-043fb38025c0" released by "delete_volume" :: held 1.896s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:05:24 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-1e2e7c35-1bde-44d8-8606-f6ee3f143662 tempest-GroupSnapshotsTest-1813075391 None] Created reservations ['1e34dd72-84b2-4060-8d43-5bec139d34b7'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:05:24 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3b728da2-55ed-4caa-96e2-9d7a17829a6b tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.info" returned: 0 in 0.857s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:24 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-3b728da2-55ed-4caa-96e2-9d7a17829a6b tempest-VolumesSnapshotListTestJSON-228850654 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.info is being set with open permissions: ugo+rw Jul 08 01:05:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3b728da2-55ed-4caa-96e2-9d7a17829a6b tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:24 devstack cinder-volume[87123]: WARNING cinder.quota [None req-1e2e7c35-1bde-44d8-8606-f6ee3f143662 tempest-GroupSnapshotsTest-1813075391 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-127651775 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-127651775, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:05:24 devstack sudo[93273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.info Jul 08 01:05:24 devstack sudo[93273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:24 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-1e2e7c35-1bde-44d8-8606-f6ee3f143662 tempest-GroupSnapshotsTest-1813075391 None] Created reservations ['e5af3697-462d-4cef-a150-284ee4c0d128', '131bfd10-a82a-47c5-903e-bb60b9caa7de', 'ba75a671-c6ee-4ed4-b2a8-f72bd9d6e53c', '288c54ea-b5d1-445d-b289-7e4c1dfbb386'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:05:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1e2e7c35-1bde-44d8-8606-f6ee3f143662 tempest-GroupSnapshotsTest-1813075391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1e2e7c35-1bde-44d8-8606-f6ee3f143662 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1e2e7c35-1bde-44d8-8606-f6ee3f143662 tempest-GroupSnapshotsTest-1813075391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:05:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1e2e7c35-1bde-44d8-8606-f6ee3f143662 tempest-GroupSnapshotsTest-1813075391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:05:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1e2e7c35-1bde-44d8-8606-f6ee3f143662 tempest-GroupSnapshotsTest-1813075391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1e2e7c35-1bde-44d8-8606-f6ee3f143662 tempest-GroupSnapshotsTest-1813075391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:24 devstack sudo[93275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:05:24 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:25 devstack sudo[93273]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3b728da2-55ed-4caa-96e2-9d7a17829a6b tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.info" returned: 0 in 0.889s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3b728da2-55ed-4caa-96e2-9d7a17829a6b tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.506s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.214s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-240231889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5faae36d-d2ef-45ce-9276-e51d68821896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd62ddc1bc3440f9399d30f12c1ac69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:05:23Z,use_quota=True,user_id='2d8ce5452ccb411592fbdbc080b8a1ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:05:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Creating volume 5faae36d-d2ef-45ce-9276-e51d68821896 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:05:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:05:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:05:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:05:25 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:05:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5faae36d-d2ef-45ce-9276-e51d68821896 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:25 devstack sudo[93278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5faae36d-d2ef-45ce-9276-e51d68821896 1073741824 Jul 08 01:05:25 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:25 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-3b728da2-55ed-4caa-96e2-9d7a17829a6b tempest-VolumesSnapshotListTestJSON-228850654 None] Create snapshot completed successfully Jul 08 01:05:25 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1e2e7c35-1bde-44d8-8606-f6ee3f143662 tempest-GroupSnapshotsTest-1813075391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.089s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:25 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-1e2e7c35-1bde-44d8-8606-f6ee3f143662 tempest-GroupSnapshotsTest-1813075391 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:05:25 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-1e2e7c35-1bde-44d8-8606-f6ee3f143662 tempest-GroupSnapshotsTest-1813075391 None] Delete group completed successfully. Jul 08 01:05:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d0da1347-e69f-4613-b4ab-98b0d895133c tempest-VolumesSnapshotListTestJSON-228850654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:26 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5faae36d-d2ef-45ce-9276-e51d68821896 1073741824" returned: 0 in 1.292s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5faae36d-d2ef-45ce-9276-e51d68821896 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:26 devstack sudo[93285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5faae36d-d2ef-45ce-9276-e51d68821896 Jul 08 01:05:26 devstack sudo[93285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:27 devstack sudo[93285]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5faae36d-d2ef-45ce-9276-e51d68821896" returned: 0 in 0.799s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] <== create_volume: return (2167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:05:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.171s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d0da1347-e69f-4613-b4ab-98b0d895133c tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.059s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9645099e-6dad-4dd1-9f74-2cc4c5609498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5faae36d-d2ef-45ce-9276-e51d68821896', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2a9b2c-9fc3-48d4-9839-a7bc061074f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-d0da1347-e69f-4613-b4ab-98b0d895133c tempest-VolumesSnapshotListTestJSON-228850654 None] Creating offline snapshot 70fb5c51-0314-4834-896d-25b01dc08d5d of volume 60bddbaf-7e35-4cfd-beb8-9bb66f677343 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:05:27 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Volume volume-5faae36d-d2ef-45ce-9276-e51d68821896 (5faae36d-d2ef-45ce-9276-e51d68821896): created successfully Jul 08 01:05:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2a9b2c-9fc3-48d4-9839-a7bc061074f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Flow 'volume_create_manager' (33e0a69c-0705-496a-8df4-9fd5ccc36810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:05:27 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbe52f0-705a-486d-aa14-138b261a17bb]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d0da1347-e69f-4613-b4ab-98b0d895133c tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:27 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-7966dcad-0169-4eda-83fd-e46f4676e708 tempest-AttachVolumeTestJSON-1636764410 None] Created volume successfully. Jul 08 01:05:27 devstack sudo[93290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb Jul 08 01:05:27 devstack sudo[93290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:28 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:05:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Flow 'volume_create_manager' (aee9b6db-b7db-4f39-a223-dfa322bf8a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:05:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db5061a-6c9e-4057-8f7b-a823e821ce41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5db5061a-6c9e-4057-8f7b-a823e821ce41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1513969840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb23cee6-2a1c-4961-b27c-445382c45e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd8b0494e0f49588b32ce1d5a18ef2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:05:28Z,use_quota=True,user_id='83da6367b17d42788b2ce052d834054a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1685545b-80e4-4c55-85ad-f69a26b776c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1685545b-80e4-4c55-85ad-f69a26b776c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b3d6965-b7af-4db7-9bea-062319dc6e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b3d6965-b7af-4db7-9bea-062319dc6e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb23cee6-2a1c-4961-b27c-445382c45e2b', 'volume_name': 'volume-fb23cee6-2a1c-4961-b27c-445382c45e2b', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15705808-ec1b-4471-9edf-121ec2b8d1fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15705808-ec1b-4471-9edf-121ec2b8d1fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce6fea56-c490-4c1f-9b79-f5a11fcc7c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:28 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Volume fb23cee6-2a1c-4961-b27c-445382c45e2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb23cee6-2a1c-4961-b27c-445382c45e2b', 'volume_size': 1} Jul 08 01:05:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:28 devstack sudo[93290]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d0da1347-e69f-4613-b4ab-98b0d895133c tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb" returned: 0 in 1.018s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:28 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-d0da1347-e69f-4613-b4ab-98b0d895133c tempest-VolumesSnapshotListTestJSON-228850654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:05:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d0da1347-e69f-4613-b4ab-98b0d895133c tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:28 devstack sudo[93296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d 1G Jul 08 01:05:28 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:29 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d0da1347-e69f-4613-b4ab-98b0d895133c tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d 1G" returned: 0 in 1.001s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d0da1347-e69f-4613-b4ab-98b0d895133c tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:29 devstack sudo[93305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d Jul 08 01:05:29 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:30 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d0da1347-e69f-4613-b4ab-98b0d895133c tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d" returned: 0 in 0.872s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:30 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-d0da1347-e69f-4613-b4ab-98b0d895133c tempest-VolumesSnapshotListTestJSON-228850654 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d is being set with open permissions: ugo+rw Jul 08 01:05:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d0da1347-e69f-4613-b4ab-98b0d895133c tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:30 devstack sudo[93311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d Jul 08 01:05:30 devstack sudo[93311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d0da1347-e69f-4613-b4ab-98b0d895133c tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d" returned: 0 in 0.743s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:31 devstack sudo[93311]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d0da1347-e69f-4613-b4ab-98b0d895133c tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.791s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.750s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:05:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1513969840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb23cee6-2a1c-4961-b27c-445382c45e2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd8b0494e0f49588b32ce1d5a18ef2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:05:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:05:28Z,use_quota=True,user_id='83da6367b17d42788b2ce052d834054a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:05:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Creating volume fb23cee6-2a1c-4961-b27c-445382c45e2b {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:05:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:05:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:05:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:05:31 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:05:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fb23cee6-2a1c-4961-b27c-445382c45e2b 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:31 devstack sudo[93315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fb23cee6-2a1c-4961-b27c-445382c45e2b 1073741824 Jul 08 01:05:31 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:31 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-d0da1347-e69f-4613-b4ab-98b0d895133c tempest-VolumesSnapshotListTestJSON-228850654 None] Create snapshot completed successfully Jul 08 01:05:31 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-65294b0d-948a-4ec3-a855-a49f95d27a8d tempest-GroupsV320Test-1178240205 None] Group tempest-GroupsV320Test-Group-1641580353: creating Jul 08 01:05:31 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-65294b0d-948a-4ec3-a855-a49f95d27a8d tempest-GroupsV320Test-1178240205 None] Group tempest-GroupsV320Test-Group-1641580353: created successfully Jul 08 01:05:31 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-65294b0d-948a-4ec3-a855-a49f95d27a8d tempest-GroupsV320Test-1178240205 None] Create group completed successfully. Jul 08 01:05:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9fd9f481-f5bf-4ca5-b356-85cedd7dec50 tempest-VolumesSnapshotListTestJSON-228850654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-95ed4dc0-c641-4678-b4d5-46d501ea944f req-d3218e35-6e84-4f52-a44d-c1e1de3ebba1 tempest-AttachVolumeTestJSON-1636764410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:32 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fb23cee6-2a1c-4961-b27c-445382c45e2b 1073741824" returned: 0 in 0.934s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fb23cee6-2a1c-4961-b27c-445382c45e2b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:32 devstack sudo[93328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fb23cee6-2a1c-4961-b27c-445382c45e2b Jul 08 01:05:32 devstack sudo[93328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:32 devstack sudo[93328]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fb23cee6-2a1c-4961-b27c-445382c45e2b" returned: 0 in 0.705s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:05:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9fd9f481-f5bf-4ca5-b356-85cedd7dec50 tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.111s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-9fd9f481-f5bf-4ca5-b356-85cedd7dec50 tempest-VolumesSnapshotListTestJSON-228850654 None] Creating offline snapshot 6de15ad6-fe77-44e8-a719-d11d2c6163e9 of volume 60bddbaf-7e35-4cfd-beb8-9bb66f677343 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:05:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce6fea56-c490-4c1f-9b79-f5a11fcc7c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb23cee6-2a1c-4961-b27c-445382c45e2b', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e79c56-6a45-4145-b06c-30635946e23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:32 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[3042410d-4dde-434b-9e35-e9b8aa67179d]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9fd9f481-f5bf-4ca5-b356-85cedd7dec50 tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:33 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Volume volume-fb23cee6-2a1c-4961-b27c-445382c45e2b (fb23cee6-2a1c-4961-b27c-445382c45e2b): created successfully Jul 08 01:05:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77e79c56-6a45-4145-b06c-30635946e23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Flow 'volume_create_manager' (aee9b6db-b7db-4f39-a223-dfa322bf8a7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:05:33 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-1c2bcfef-8aa8-42da-9ca3-bf6883cf0f2e tempest-AttachVolumeNegativeTest-1707411501 None] Created volume successfully. Jul 08 01:05:33 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-30d2daa6-cf74-44c7-89b2-0ea2a472c913 tempest-GroupsV320Test-1178240205 None] Created reservations ['884b36a5-3a28-42ec-b209-5dfbe3b16095'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:05:33 devstack sudo[93331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d Jul 08 01:05:33 devstack sudo[93331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-30d2daa6-cf74-44c7-89b2-0ea2a472c913 tempest-GroupsV320Test-1178240205 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-30d2daa6-cf74-44c7-89b2-0ea2a472c913 tempest-GroupsV320Test-1178240205 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-30d2daa6-cf74-44c7-89b2-0ea2a472c913 tempest-GroupsV320Test-1178240205 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:05:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-30d2daa6-cf74-44c7-89b2-0ea2a472c913 tempest-GroupsV320Test-1178240205 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:05:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-30d2daa6-cf74-44c7-89b2-0ea2a472c913 tempest-GroupsV320Test-1178240205 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-30d2daa6-cf74-44c7-89b2-0ea2a472c913 tempest-GroupsV320Test-1178240205 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:33 devstack sudo[93333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:05:33 devstack sudo[93333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:33 devstack sudo[93333]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-30d2daa6-cf74-44c7-89b2-0ea2a472c913 tempest-GroupsV320Test-1178240205 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.723s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:33 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-30d2daa6-cf74-44c7-89b2-0ea2a472c913 tempest-GroupsV320Test-1178240205 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:05:33 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-30d2daa6-cf74-44c7-89b2-0ea2a472c913 tempest-GroupsV320Test-1178240205 None] Delete group completed successfully. Jul 08 01:05:33 devstack sudo[93331]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9fd9f481-f5bf-4ca5-b356-85cedd7dec50 tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d" returned: 0 in 0.967s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-9fd9f481-f5bf-4ca5-b356-85cedd7dec50 tempest-VolumesSnapshotListTestJSON-228850654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:05:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9fd9f481-f5bf-4ca5-b356-85cedd7dec50 tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.6de15ad6-fe77-44e8-a719-d11d2c6163e9 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:33 devstack sudo[93343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.6de15ad6-fe77-44e8-a719-d11d2c6163e9 1G Jul 08 01:05:33 devstack sudo[93343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:34 devstack sudo[93343]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9fd9f481-f5bf-4ca5-b356-85cedd7dec50 tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.6de15ad6-fe77-44e8-a719-d11d2c6163e9 1G" returned: 0 in 0.990s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9fd9f481-f5bf-4ca5-b356-85cedd7dec50 tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.6de15ad6-fe77-44e8-a719-d11d2c6163e9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:34 devstack sudo[93348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.6de15ad6-fe77-44e8-a719-d11d2c6163e9 Jul 08 01:05:34 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:35 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9fd9f481-f5bf-4ca5-b356-85cedd7dec50 tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.6de15ad6-fe77-44e8-a719-d11d2c6163e9" returned: 0 in 0.748s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:35 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-9fd9f481-f5bf-4ca5-b356-85cedd7dec50 tempest-VolumesSnapshotListTestJSON-228850654 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.6de15ad6-fe77-44e8-a719-d11d2c6163e9 is being set with open permissions: ugo+rw Jul 08 01:05:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9fd9f481-f5bf-4ca5-b356-85cedd7dec50 tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.6de15ad6-fe77-44e8-a719-d11d2c6163e9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:35 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.6de15ad6-fe77-44e8-a719-d11d2c6163e9 Jul 08 01:05:35 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:36 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9fd9f481-f5bf-4ca5-b356-85cedd7dec50 tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.6de15ad6-fe77-44e8-a719-d11d2c6163e9" returned: 0 in 0.873s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9fd9f481-f5bf-4ca5-b356-85cedd7dec50 tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.735s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-95ed4dc0-c641-4678-b4d5-46d501ea944f req-d3218e35-6e84-4f52-a44d-c1e1de3ebba1 tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 4.701s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:36 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf2b6eeb-caf3-44d3-abbf-62165bf8b3fc]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-95ed4dc0-c641-4678-b4d5-46d501ea944f req-d3218e35-6e84-4f52-a44d-c1e1de3ebba1 tempest-AttachVolumeTestJSON-1636764410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5faae36d-d2ef-45ce-9276-e51d68821896 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:36 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-9fd9f481-f5bf-4ca5-b356-85cedd7dec50 tempest-VolumesSnapshotListTestJSON-228850654 None] Create snapshot completed successfully Jul 08 01:05:36 devstack sudo[93357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5faae36d-d2ef-45ce-9276-e51d68821896 Jul 08 01:05:36 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-a64b3c89-80f1-4764-a041-a784aeded90a req-cd04b50b-9465-4702-81ae-f4979c95e863 tempest-AttachVolumeNegativeTest-1707411501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:37 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-95ed4dc0-c641-4678-b4d5-46d501ea944f req-d3218e35-6e84-4f52-a44d-c1e1de3ebba1 tempest-AttachVolumeTestJSON-1636764410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5faae36d-d2ef-45ce-9276-e51d68821896" returned: 0 in 0.934s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-95ed4dc0-c641-4678-b4d5-46d501ea944f req-d3218e35-6e84-4f52-a44d-c1e1de3ebba1 tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.966s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-a64b3c89-80f1-4764-a041-a784aeded90a req-cd04b50b-9465-4702-81ae-f4979c95e863 tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.531s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:37 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[139565e6-b0c7-47ad-a085-fb8ee755a9f2]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-a64b3c89-80f1-4764-a041-a784aeded90a req-cd04b50b-9465-4702-81ae-f4979c95e863 tempest-AttachVolumeNegativeTest-1707411501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fb23cee6-2a1c-4961-b27c-445382c45e2b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-95ed4dc0-c641-4678-b4d5-46d501ea944f req-d3218e35-6e84-4f52-a44d-c1e1de3ebba1 tempest-AttachVolumeTestJSON-1636764410 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e', 'name': 'volume-5faae36d-d2ef-45ce-9276-e51d68821896', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6f7591d4-4ba7-4c97-a861-c41f2db71d9e', 'enforce_multipath': True} {{(pid=87123) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:05:37 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-95ed4dc0-c641-4678-b4d5-46d501ea944f req-d3218e35-6e84-4f52-a44d-c1e1de3ebba1 tempest-AttachVolumeTestJSON-1636764410 None] attachment_update completed successfully. Jul 08 01:05:37 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fb23cee6-2a1c-4961-b27c-445382c45e2b Jul 08 01:05:37 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:38 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-a64b3c89-80f1-4764-a041-a784aeded90a req-cd04b50b-9465-4702-81ae-f4979c95e863 tempest-AttachVolumeNegativeTest-1707411501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fb23cee6-2a1c-4961-b27c-445382c45e2b" returned: 0 in 1.045s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-a64b3c89-80f1-4764-a041-a784aeded90a req-cd04b50b-9465-4702-81ae-f4979c95e863 tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.071s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-a64b3c89-80f1-4764-a041-a784aeded90a req-cd04b50b-9465-4702-81ae-f4979c95e863 tempest-AttachVolumeNegativeTest-1707411501 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e', 'name': 'volume-fb23cee6-2a1c-4961-b27c-445382c45e2b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '61ea6c94-cab6-4a2f-b222-0fa6227303ee', 'enforce_multipath': True} {{(pid=87123) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:05:38 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-a64b3c89-80f1-4764-a041-a784aeded90a req-cd04b50b-9465-4702-81ae-f4979c95e863 tempest-AttachVolumeNegativeTest-1707411501 None] attachment_update completed successfully. Jul 08 01:05:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] Acquiring lock "cinder-6de15ad6-fe77-44e8-a719-d11d2c6163e9-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:05:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "cinder-6de15ad6-fe77-44e8-a719-d11d2c6163e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:05:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] Acquiring lock "cinder-quobyte-60bddbaf-7e35-4cfd-beb8-9bb66f677343" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:05:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "cinder-quobyte-60bddbaf-7e35-4cfd-beb8-9bb66f677343" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:05:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] Acquiring lock "cinder-quobyte-6de15ad6-fe77-44e8-a719-d11d2c6163e9" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:05:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "cinder-quobyte-6de15ad6-fe77-44e8-a719-d11d2c6163e9" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:05:39 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] Deleting offline snapshot 6de15ad6-fe77-44e8-a719-d11d2c6163e9 of volume 60bddbaf-7e35-4cfd-beb8-9bb66f677343 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:05:39 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] snapshot_file for this snap is: volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.6de15ad6-fe77-44e8-a719-d11d2c6163e9 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:05:39 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c47b7b8-4ca2-4dca-babe-ebc17fb7ed96]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.6de15ad6-fe77-44e8-a719-d11d2c6163e9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:39 devstack sudo[93758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.6de15ad6-fe77-44e8-a719-d11d2c6163e9 Jul 08 01:05:39 devstack sudo[93758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:40 devstack sudo[93758]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.6de15ad6-fe77-44e8-a719-d11d2c6163e9" returned: 0 in 0.845s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d32d55b-cde3-4d8d-adce-e5949c75ce08]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:40 devstack sudo[93767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d Jul 08 01:05:40 devstack sudo[93767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Flow 'volume_create_manager' (4fe5c1ce-7400-43f2-b29c-c6f0fc8ca3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47d40cc-7bb7-4270-935d-9774f7ae1cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47d40cc-7bb7-4270-935d-9774f7ae1cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-672366021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a77d355-26da-4100-9dec-3898dfb27dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517ad6c1994d4fdcbc37e598ac0587a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:05:41Z,use_quota=True,user_id='5bbe1538f99e46dc84e6fe17d5a6bcca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2df96e-6fc9-490e-bb79-9cf517deba11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2df96e-6fc9-490e-bb79-9cf517deba11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9447bf9-fe67-4226-8564-cd669dfe451b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9447bf9-fe67-4226-8564-cd669dfe451b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a77d355-26da-4100-9dec-3898dfb27dc6', 'volume_name': 'volume-9a77d355-26da-4100-9dec-3898dfb27dc6', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa06a079-6e0c-492c-9a63-92d1e61d7750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa06a079-6e0c-492c-9a63-92d1e61d7750) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8510f48-36cf-47d7-a5f8-aca90e9a7b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:40 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Volume 9a77d355-26da-4100-9dec-3898dfb27dc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a77d355-26da-4100-9dec-3898dfb27dc6', 'volume_size': 1} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-672366021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a77d355-26da-4100-9dec-3898dfb27dc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='517ad6c1994d4fdcbc37e598ac0587a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:05:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:05:41Z,use_quota=True,user_id='5bbe1538f99e46dc84e6fe17d5a6bcca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Creating volume 9a77d355-26da-4100-9dec-3898dfb27dc6 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:05:40 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:05:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:40 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6 1073741824 Jul 08 01:05:40 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:41 devstack sudo[93767]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d" returned: 0 in 0.909s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:41 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:05:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.6de15ad6-fe77-44e8-a719-d11d2c6163e9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:41 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.6de15ad6-fe77-44e8-a719-d11d2c6163e9 Jul 08 01:05:41 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:41 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6 1073741824" returned: 0 in 1.086s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:41 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6 Jul 08 01:05:41 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:42 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.6de15ad6-fe77-44e8-a719-d11d2c6163e9" returned: 0 in 1.022s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.6de15ad6-fe77-44e8-a719-d11d2c6163e9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:42 devstack sudo[93785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.6de15ad6-fe77-44e8-a719-d11d2c6163e9 Jul 08 01:05:42 devstack sudo[93785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:42 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6" returned: 0 in 0.922s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] <== create_volume: return (2059ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:05:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.063s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8510f48-36cf-47d7-a5f8-aca90e9a7b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a77d355-26da-4100-9dec-3898dfb27dc6', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a729e518-b65a-4d4e-bc7f-27baf61b3576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:05:42 devstack sudo[93785]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.6de15ad6-fe77-44e8-a719-d11d2c6163e9" returned: 0 in 0.807s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:42 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "cinder-quobyte-6de15ad6-fe77-44e8-a719-d11d2c6163e9" released by "_delete_snapshot" :: held 3.737s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:05:42 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Volume volume-9a77d355-26da-4100-9dec-3898dfb27dc6 (9a77d355-26da-4100-9dec-3898dfb27dc6): created successfully Jul 08 01:05:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a729e518-b65a-4d4e-bc7f-27baf61b3576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:05:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Flow 'volume_create_manager' (4fe5c1ce-7400-43f2-b29c-c6f0fc8ca3d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:05:42 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "cinder-quobyte-60bddbaf-7e35-4cfd-beb8-9bb66f677343" released by "delete_snapshot" :: held 3.801s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:05:42 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-d440413a-1eb1-4979-be9a-8d79b14fe5ce tempest-SnapshotsActionsTest-1528752516 None] Created volume successfully. Jul 08 01:05:43 devstack cinder-volume[87123]: WARNING cinder.quota [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:05:43 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] Created reservations ['6364cb68-4253-435a-adcb-515d1d09f126', '67ca3e97-2f93-4c7a-a1dd-4778eea8c756', '7999bf2a-5467-47ff-b4f8-e13f164ea226', 'e2dd0980-7da3-4966-80cd-681b649612ad'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:05:43 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] Delete snapshot completed successfully. Jul 08 01:05:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-87018845-8ba0-4ca4-821b-fc3f915c44d2 tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "cinder-6de15ad6-fe77-44e8-a719-d11d2c6163e9-delete_snapshot" released by "delete_snapshot" :: held 4.034s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:05:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] Acquiring lock "cinder-70fb5c51-0314-4834-896d-25b01dc08d5d-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:05:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "cinder-70fb5c51-0314-4834-896d-25b01dc08d5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:05:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] Acquiring lock "cinder-quobyte-60bddbaf-7e35-4cfd-beb8-9bb66f677343" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:05:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "cinder-quobyte-60bddbaf-7e35-4cfd-beb8-9bb66f677343" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:05:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] Acquiring lock "cinder-quobyte-70fb5c51-0314-4834-896d-25b01dc08d5d" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:05:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "cinder-quobyte-70fb5c51-0314-4834-896d-25b01dc08d5d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:05:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] Deleting offline snapshot 70fb5c51-0314-4834-896d-25b01dc08d5d of volume 60bddbaf-7e35-4cfd-beb8-9bb66f677343 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:05:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] snapshot_file for this snap is: volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:05:43 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[546a6276-2359-49aa-8c39-9daaaa4345f6]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:43 devstack sudo[93792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d Jul 08 01:05:43 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-928d0524-2f11-491f-8280-d197b7d7bf43 tempest-SnapshotsActionsTest-1528752516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-928d0524-2f11-491f-8280-d197b7d7bf43 tempest-SnapshotsActionsTest-1528752516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-928d0524-2f11-491f-8280-d197b7d7bf43 tempest-SnapshotsActionsTest-1528752516 None] Creating offline snapshot 3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 of volume 9a77d355-26da-4100-9dec-3898dfb27dc6 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:05:44 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc0c9d6-d914-442e-9439-6259405035c1]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-928d0524-2f11-491f-8280-d197b7d7bf43 tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:44 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6 Jul 08 01:05:44 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:44 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d" returned: 0 in 0.925s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:05:44 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[be268e2a-3cf2-4edb-b72f-d3d893de62da]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:44 devstack sudo[93802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb Jul 08 01:05:44 devstack sudo[93802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:05:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:05:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:05:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:44 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:05:44 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:45 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-928d0524-2f11-491f-8280-d197b7d7bf43 tempest-SnapshotsActionsTest-1528752516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6" returned: 0 in 0.889s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-928d0524-2f11-491f-8280-d197b7d7bf43 tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:45 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 1G Jul 08 01:05:45 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:45 devstack sudo[93802]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb" returned: 0 in 0.971s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:45 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:05:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:45 devstack sudo[93818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d Jul 08 01:05:45 devstack sudo[93818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:45 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-d941cd4b-c350-43c7-be56-534604231783 req-424b250e-75a8-4d76-afb0-9c69441159c2 tempest-AttachVolumeNegativeTest-1707411501 None] Terminate volume connection completed successfully. Jul 08 01:05:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-d941cd4b-c350-43c7-be56-534604231783 req-424b250e-75a8-4d76-afb0-9c69441159c2 tempest-AttachVolumeNegativeTest-1707411501 None] Deleting attachment 61ea6c94-cab6-4a2f-b222-0fa6227303ee. {{(pid=87123) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:05:45 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.942s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:45 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:05:45 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:05:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 8 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:05:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:05:46 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-928d0524-2f11-491f-8280-d197b7d7bf43 tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 1G" returned: 0 in 1.107s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-928d0524-2f11-491f-8280-d197b7d7bf43 tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a77d355-26da-4100-9dec-3898dfb27dc6 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:46 devstack sudo[93851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a77d355-26da-4100-9dec-3898dfb27dc6 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 Jul 08 01:05:46 devstack sudo[93851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:46 devstack sudo[93818]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d" returned: 0 in 1.156s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:46 devstack sudo[93856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d Jul 08 01:05:46 devstack sudo[93856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:46 devstack sudo[93851]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-928d0524-2f11-491f-8280-d197b7d7bf43 tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a77d355-26da-4100-9dec-3898dfb27dc6 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71" returned: 0 in 0.779s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:46 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-928d0524-2f11-491f-8280-d197b7d7bf43 tempest-SnapshotsActionsTest-1528752516 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 is being set with open permissions: ugo+rw Jul 08 01:05:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-928d0524-2f11-491f-8280-d197b7d7bf43 tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:47 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 Jul 08 01:05:47 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:47 devstack sudo[93856]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.70fb5c51-0314-4834-896d-25b01dc08d5d" returned: 0 in 0.748s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "cinder-quobyte-70fb5c51-0314-4834-896d-25b01dc08d5d" released by "_delete_snapshot" :: held 3.928s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:05:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "cinder-quobyte-60bddbaf-7e35-4cfd-beb8-9bb66f677343" released by "delete_snapshot" :: held 3.955s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:05:47 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] Created reservations ['0980d597-0a59-4543-b882-c7c87262543b', '73c2d84f-b7a2-42e9-a625-0f7d0d2a6935', '98c09ab0-c1cb-44ba-95a1-e2c995cc3d6e', 'de3fe556-c8a1-44ea-a37a-dfe9267438a1'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:05:47 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] Delete snapshot completed successfully. Jul 08 01:05:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-af470511-aeb6-40d4-a6b6-2f5eea0e7549 tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "cinder-70fb5c51-0314-4834-896d-25b01dc08d5d-delete_snapshot" released by "delete_snapshot" :: held 4.207s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:05:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-50448bb6-33e1-47ea-988a-1a6b0d4f56fc tempest-VolumesSnapshotListTestJSON-228850654 None] Acquiring lock "cinder-b0c57e14-e4c7-4b07-8fbe-ce74016373eb-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:05:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-50448bb6-33e1-47ea-988a-1a6b0d4f56fc tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "cinder-b0c57e14-e4c7-4b07-8fbe-ce74016373eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:05:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-50448bb6-33e1-47ea-988a-1a6b0d4f56fc tempest-VolumesSnapshotListTestJSON-228850654 None] Acquiring lock "cinder-quobyte-60bddbaf-7e35-4cfd-beb8-9bb66f677343" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:05:47 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-928d0524-2f11-491f-8280-d197b7d7bf43 tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71" returned: 0 in 0.785s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-50448bb6-33e1-47ea-988a-1a6b0d4f56fc tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "cinder-quobyte-60bddbaf-7e35-4cfd-beb8-9bb66f677343" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:05:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-50448bb6-33e1-47ea-988a-1a6b0d4f56fc tempest-VolumesSnapshotListTestJSON-228850654 None] Acquiring lock "cinder-quobyte-b0c57e14-e4c7-4b07-8fbe-ce74016373eb" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:05:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-50448bb6-33e1-47ea-988a-1a6b0d4f56fc tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "cinder-quobyte-b0c57e14-e4c7-4b07-8fbe-ce74016373eb" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:05:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-50448bb6-33e1-47ea-988a-1a6b0d4f56fc tempest-VolumesSnapshotListTestJSON-228850654 None] Deleting offline snapshot b0c57e14-e4c7-4b07-8fbe-ce74016373eb of volume 60bddbaf-7e35-4cfd-beb8-9bb66f677343 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:05:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-50448bb6-33e1-47ea-988a-1a6b0d4f56fc tempest-VolumesSnapshotListTestJSON-228850654 None] snapshot_file for this snap is: volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:05:47 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be9cffc-09a7-40a2-8a8e-56df2d773d79]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50448bb6-33e1-47ea-988a-1a6b0d4f56fc tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-928d0524-2f11-491f-8280-d197b7d7bf43 tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:47 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.info Jul 08 01:05:47 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:48 devstack sudo[93865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb Jul 08 01:05:48 devstack sudo[93865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:48 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-928d0524-2f11-491f-8280-d197b7d7bf43 tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.info" returned: 0 in 0.817s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:48 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-928d0524-2f11-491f-8280-d197b7d7bf43 tempest-SnapshotsActionsTest-1528752516 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.info is being set with open permissions: ugo+rw Jul 08 01:05:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-928d0524-2f11-491f-8280-d197b7d7bf43 tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:48 devstack sudo[93873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.info Jul 08 01:05:48 devstack sudo[93873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:48 devstack sudo[93865]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50448bb6-33e1-47ea-988a-1a6b0d4f56fc tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb" returned: 0 in 1.020s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-50448bb6-33e1-47ea-988a-1a6b0d4f56fc tempest-VolumesSnapshotListTestJSON-228850654 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:05:48 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[64ae2d92-0f55-49f4-8b24-1af2932c1ad5]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50448bb6-33e1-47ea-988a-1a6b0d4f56fc tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:49 devstack sudo[93877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343 Jul 08 01:05:49 devstack sudo[93877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:49 devstack sudo[93873]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-928d0524-2f11-491f-8280-d197b7d7bf43 tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.info" returned: 0 in 0.894s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-928d0524-2f11-491f-8280-d197b7d7bf43 tempest-SnapshotsActionsTest-1528752516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.473s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:49 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-928d0524-2f11-491f-8280-d197b7d7bf43 tempest-SnapshotsActionsTest-1528752516 None] Create snapshot completed successfully Jul 08 01:05:50 devstack sudo[93877]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50448bb6-33e1-47ea-988a-1a6b0d4f56fc tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343" returned: 0 in 1.161s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50448bb6-33e1-47ea-988a-1a6b0d4f56fc tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:50 devstack sudo[93904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb Jul 08 01:05:50 devstack sudo[93904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:51 devstack sudo[93904]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50448bb6-33e1-47ea-988a-1a6b0d4f56fc tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb" returned: 0 in 1.166s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50448bb6-33e1-47ea-988a-1a6b0d4f56fc tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f9c1c227-7580-4e52-a265-4420ef555832 tempest-SnapshotsActionsTest-1528752516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f9c1c227-7580-4e52-a265-4420ef555832 tempest-SnapshotsActionsTest-1528752516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f9c1c227-7580-4e52-a265-4420ef555832 tempest-SnapshotsActionsTest-1528752516 None] Creating offline snapshot e71ff254-a5c3-42a8-9ae3-ea72d34a663f of volume 9a77d355-26da-4100-9dec-3898dfb27dc6 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:05:51 devstack sudo[93920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb Jul 08 01:05:51 devstack sudo[93920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:51 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[72207c8d-8ab2-410d-9a40-5960405b4c06]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f9c1c227-7580-4e52-a265-4420ef555832 tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:51 devstack sudo[93929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 Jul 08 01:05:51 devstack sudo[93929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:52 devstack sudo[93920]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50448bb6-33e1-47ea-988a-1a6b0d4f56fc tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343.b0c57e14-e4c7-4b07-8fbe-ce74016373eb" returned: 0 in 1.247s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-50448bb6-33e1-47ea-988a-1a6b0d4f56fc tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "cinder-quobyte-b0c57e14-e4c7-4b07-8fbe-ce74016373eb" released by "_delete_snapshot" :: held 4.746s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:05:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-50448bb6-33e1-47ea-988a-1a6b0d4f56fc tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "cinder-quobyte-60bddbaf-7e35-4cfd-beb8-9bb66f677343" released by "delete_snapshot" :: held 4.779s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:05:52 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-50448bb6-33e1-47ea-988a-1a6b0d4f56fc tempest-VolumesSnapshotListTestJSON-228850654 None] Created reservations ['c999b557-5f64-4924-8458-8d1c50655757', '684d7748-f637-44cf-bd1c-3ea13bba39d4', '64d27d92-63ef-4d82-b745-9229f98b5067', 'c5804ad6-f920-4c65-9088-3806e04200a2'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:05:52 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-50448bb6-33e1-47ea-988a-1a6b0d4f56fc tempest-VolumesSnapshotListTestJSON-228850654 None] Delete snapshot completed successfully. Jul 08 01:05:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-50448bb6-33e1-47ea-988a-1a6b0d4f56fc tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "cinder-b0c57e14-e4c7-4b07-8fbe-ce74016373eb-delete_snapshot" released by "delete_snapshot" :: held 4.942s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:05:52 devstack sudo[93929]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f9c1c227-7580-4e52-a265-4420ef555832 tempest-SnapshotsActionsTest-1528752516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71" returned: 0 in 1.286s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f9c1c227-7580-4e52-a265-4420ef555832 tempest-SnapshotsActionsTest-1528752516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a77d355-26da-4100-9dec-3898dfb27dc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:05:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f9c1c227-7580-4e52-a265-4420ef555832 tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.e71ff254-a5c3-42a8-9ae3-ea72d34a663f 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:52 devstack sudo[94005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.e71ff254-a5c3-42a8-9ae3-ea72d34a663f 1G Jul 08 01:05:52 devstack sudo[94005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-51c1729b-2fa4-4046-b561-6790936d38ef tempest-VolumesSnapshotListTestJSON-228850654 None] Acquiring lock "cinder-60bddbaf-7e35-4cfd-beb8-9bb66f677343-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:05:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-51c1729b-2fa4-4046-b561-6790936d38ef tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "cinder-60bddbaf-7e35-4cfd-beb8-9bb66f677343-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:05:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-51c1729b-2fa4-4046-b561-6790936d38ef tempest-VolumesSnapshotListTestJSON-228850654 None] Acquiring lock "cinder-quobyte-60bddbaf-7e35-4cfd-beb8-9bb66f677343" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:05:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-51c1729b-2fa4-4046-b561-6790936d38ef tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "cinder-quobyte-60bddbaf-7e35-4cfd-beb8-9bb66f677343" acquired by "delete_volume" :: waited 0.028s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:05:53 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1690375-17a8-4270-9d23-a17e1c2f0db3]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-51c1729b-2fa4-4046-b561-6790936d38ef tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:53 devstack sudo[94011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343 Jul 08 01:05:53 devstack sudo[94011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:53 devstack sudo[94005]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f9c1c227-7580-4e52-a265-4420ef555832 tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.e71ff254-a5c3-42a8-9ae3-ea72d34a663f 1G" returned: 0 in 0.961s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f9c1c227-7580-4e52-a265-4420ef555832 tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.e71ff254-a5c3-42a8-9ae3-ea72d34a663f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:53 devstack sudo[94019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.e71ff254-a5c3-42a8-9ae3-ea72d34a663f Jul 08 01:05:53 devstack sudo[94019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:54 devstack sudo[94011]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-51c1729b-2fa4-4046-b561-6790936d38ef tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343" returned: 0 in 0.970s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-51c1729b-2fa4-4046-b561-6790936d38ef tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:54 devstack sudo[94031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343 Jul 08 01:05:54 devstack sudo[94031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:54 devstack sudo[94019]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f9c1c227-7580-4e52-a265-4420ef555832 tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.e71ff254-a5c3-42a8-9ae3-ea72d34a663f" returned: 0 in 0.802s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:54 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-f9c1c227-7580-4e52-a265-4420ef555832 tempest-SnapshotsActionsTest-1528752516 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.e71ff254-a5c3-42a8-9ae3-ea72d34a663f is being set with open permissions: ugo+rw Jul 08 01:05:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f9c1c227-7580-4e52-a265-4420ef555832 tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.e71ff254-a5c3-42a8-9ae3-ea72d34a663f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:54 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.e71ff254-a5c3-42a8-9ae3-ea72d34a663f Jul 08 01:05:54 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:55 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f9c1c227-7580-4e52-a265-4420ef555832 tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.e71ff254-a5c3-42a8-9ae3-ea72d34a663f" returned: 0 in 0.828s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f9c1c227-7580-4e52-a265-4420ef555832 tempest-SnapshotsActionsTest-1528752516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.113s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:55 devstack sudo[94031]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-51c1729b-2fa4-4046-b561-6790936d38ef tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-60bddbaf-7e35-4cfd-beb8-9bb66f677343" returned: 0 in 1.062s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:55 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f9c1c227-7580-4e52-a265-4420ef555832 tempest-SnapshotsActionsTest-1528752516 None] Create snapshot completed successfully Jul 08 01:05:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-51c1729b-2fa4-4046-b561-6790936d38ef tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "cinder-quobyte-60bddbaf-7e35-4cfd-beb8-9bb66f677343" released by "delete_volume" :: held 2.160s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:05:55 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-51c1729b-2fa4-4046-b561-6790936d38ef tempest-VolumesSnapshotListTestJSON-228850654 None] Created reservations ['76e4a5db-ee5a-4c76-bd05-0990e637c878', '11bbbb7e-8642-4ae7-8a2a-81f7665a07d5', '047d87a5-5c49-4af5-9f4e-f160f4271d91', '08c38d14-986e-4bfc-9643-882c6d2b4255'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:05:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-51c1729b-2fa4-4046-b561-6790936d38ef tempest-VolumesSnapshotListTestJSON-228850654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:05:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-51c1729b-2fa4-4046-b561-6790936d38ef tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:05:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-51c1729b-2fa4-4046-b561-6790936d38ef tempest-VolumesSnapshotListTestJSON-228850654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:05:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-51c1729b-2fa4-4046-b561-6790936d38ef tempest-VolumesSnapshotListTestJSON-228850654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:05:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-51c1729b-2fa4-4046-b561-6790936d38ef tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:05:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-51c1729b-2fa4-4046-b561-6790936d38ef tempest-VolumesSnapshotListTestJSON-228850654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:55 devstack sudo[94403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:05:55 devstack sudo[94403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:56 devstack sudo[94403]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] Acquiring lock "cinder-e71ff254-a5c3-42a8-9ae3-ea72d34a663f-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:05:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-51c1729b-2fa4-4046-b561-6790936d38ef tempest-VolumesSnapshotListTestJSON-228850654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.140s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:56 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-51c1729b-2fa4-4046-b561-6790936d38ef tempest-VolumesSnapshotListTestJSON-228850654 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:05:57 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-51c1729b-2fa4-4046-b561-6790936d38ef tempest-VolumesSnapshotListTestJSON-228850654 None] Deleted volume successfully. Jul 08 01:05:57 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=120,cinder:UPDATE=109,cinder:INSERT=24,cinder:DELETE=6 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:05:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-e71ff254-a5c3-42a8-9ae3-ea72d34a663f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:05:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] Acquiring lock "cinder-quobyte-9a77d355-26da-4100-9dec-3898dfb27dc6" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:05:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-quobyte-9a77d355-26da-4100-9dec-3898dfb27dc6" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:05:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] Acquiring lock "cinder-quobyte-e71ff254-a5c3-42a8-9ae3-ea72d34a663f" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:05:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-51c1729b-2fa4-4046-b561-6790936d38ef tempest-VolumesSnapshotListTestJSON-228850654 None] Lock "cinder-60bddbaf-7e35-4cfd-beb8-9bb66f677343-delete_volume" released by "delete_volume" :: held 3.821s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:05:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-quobyte-e71ff254-a5c3-42a8-9ae3-ea72d34a663f" acquired by "_delete_snapshot" :: waited 0.056s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:05:57 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] Deleting offline snapshot e71ff254-a5c3-42a8-9ae3-ea72d34a663f of volume 9a77d355-26da-4100-9dec-3898dfb27dc6 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:05:57 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] snapshot_file for this snap is: volume-9a77d355-26da-4100-9dec-3898dfb27dc6.e71ff254-a5c3-42a8-9ae3-ea72d34a663f {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:05:57 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[f668f0c8-923e-4912-bb7c-c828310fcc33]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.e71ff254-a5c3-42a8-9ae3-ea72d34a663f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:57 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.e71ff254-a5c3-42a8-9ae3-ea72d34a663f Jul 08 01:05:57 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:05:58 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Jul 08 01:05:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.e71ff254-a5c3-42a8-9ae3-ea72d34a663f" returned: 0 in 1.520s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:05:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a77d355-26da-4100-9dec-3898dfb27dc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:05:58 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[1306ae7f-ca6d-4258-9a2b-e94252b5d17a]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:05:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:05:59 devstack sudo[94434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 Jul 08 01:05:59 devstack sudo[94434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:00 devstack sudo[94434]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71" returned: 0 in 2.014s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a77d355-26da-4100-9dec-3898dfb27dc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:06:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.e71ff254-a5c3-42a8-9ae3-ea72d34a663f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:00 devstack sudo[94444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.e71ff254-a5c3-42a8-9ae3-ea72d34a663f Jul 08 01:06:00 devstack sudo[94444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:02 devstack sudo[94444]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.e71ff254-a5c3-42a8-9ae3-ea72d34a663f" returned: 0 in 1.236s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.e71ff254-a5c3-42a8-9ae3-ea72d34a663f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:02 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.e71ff254-a5c3-42a8-9ae3-ea72d34a663f Jul 08 01:06:02 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Flow 'volume_create_manager' (2a97d24b-6d61-4342-90fb-03b20ca69b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dce23d4-96b6-4959-8dca-a3a30b565f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=105,cinder:UPDATE=120,cinder:INSERT=31,cinder:DELETE=8 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dce23d4-96b6-4959-8dca-a3a30b565f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1138104551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec062b18-7704-4900-873f-8eeb569a7c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c10f6f9fef54d52ae0de3936104de94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:06:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:06:03Z,use_quota=True,user_id='9cbbc2675b6b48d3bb4afdc06272509f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adce01c7-70fb-4ec9-9735-0c969fc56875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adce01c7-70fb-4ec9-9735-0c969fc56875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00049f2b-b039-4a25-9b2a-e2e8520bec44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00049f2b-b039-4a25-9b2a-e2e8520bec44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec062b18-7704-4900-873f-8eeb569a7c55', 'volume_name': 'volume-ec062b18-7704-4900-873f-8eeb569a7c55', 'volume_size': 2}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e617c101-a9f9-4f95-bcbf-988210129f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e617c101-a9f9-4f95-bcbf-988210129f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539b58ab-d5a5-4721-bab4-7317f2c1d732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:06:02 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Volume ec062b18-7704-4900-873f-8eeb569a7c55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec062b18-7704-4900-873f-8eeb569a7c55', 'volume_size': 2} Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1138104551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec062b18-7704-4900-873f-8eeb569a7c55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c10f6f9fef54d52ae0de3936104de94',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:06:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:06:03Z,use_quota=True,user_id='9cbbc2675b6b48d3bb4afdc06272509f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Creating volume ec062b18-7704-4900-873f-8eeb569a7c55 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:06:02 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:06:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55 2147483648 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:02 devstack sudo[94451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55 2147483648 Jul 08 01:06:02 devstack sudo[94451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:03 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.e71ff254-a5c3-42a8-9ae3-ea72d34a663f" returned: 0 in 1.154s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-quobyte-e71ff254-a5c3-42a8-9ae3-ea72d34a663f" released by "_delete_snapshot" :: held 6.148s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-quobyte-9a77d355-26da-4100-9dec-3898dfb27dc6" released by "delete_snapshot" :: held 6.226s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:03 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] Created reservations ['53e00a78-40d1-4fe8-91d2-d2c7e8994929', 'ea1ce683-c307-48d3-bf33-97bc08f7d70a', '6f5500f8-c437-4cea-983d-c2cddf50340f', 'd96354a4-a6f6-4518-9d73-4a62ed8b874b'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:06:03 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] Delete snapshot completed successfully. Jul 08 01:06:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-aef9173b-52ea-45dd-8023-6c7b854860c9 tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-e71ff254-a5c3-42a8-9ae3-ea72d34a663f-delete_snapshot" released by "delete_snapshot" :: held 6.556s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:04 devstack sudo[94451]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55 2147483648" returned: 0 in 1.225s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:04 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55 Jul 08 01:06:04 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d2382f0a-cba9-474d-b7dd-331e91a97d42 tempest-SnapshotsActionsTest-1528752516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:06:05 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55" returned: 0 in 0.966s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:05 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] <== create_volume: return (2247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:06:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.249s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:06:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d2382f0a-cba9-474d-b7dd-331e91a97d42 tempest-SnapshotsActionsTest-1528752516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.060s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:06:05 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-d2382f0a-cba9-474d-b7dd-331e91a97d42 tempest-SnapshotsActionsTest-1528752516 None] Creating offline snapshot ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b of volume 9a77d355-26da-4100-9dec-3898dfb27dc6 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:06:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (539b58ab-d5a5-4721-bab4-7317f2c1d732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec062b18-7704-4900-873f-8eeb569a7c55', 'volume_size': 2}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:06:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093d00b2-3c22-49b4-9ec3-318680b65eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:06:05 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d5f080-d3e1-4792-bfeb-86812c232cdb]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:06:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d2382f0a-cba9-474d-b7dd-331e91a97d42 tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:05 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Volume volume-ec062b18-7704-4900-873f-8eeb569a7c55 (ec062b18-7704-4900-873f-8eeb569a7c55): created successfully Jul 08 01:06:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093d00b2-3c22-49b4-9ec3-318680b65eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:06:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Flow 'volume_create_manager' (2a97d24b-6d61-4342-90fb-03b20ca69b5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:06:05 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-fff5ae29-3671-4740-9b57-28e492037c8b tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Created volume successfully. Jul 08 01:06:05 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 Jul 08 01:06:05 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-cf2b4fc4-477c-4d0f-b0fa-1c464efc7bf6 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:06:06 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d2382f0a-cba9-474d-b7dd-331e91a97d42 tempest-SnapshotsActionsTest-1528752516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71" returned: 0 in 1.141s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:06 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-d2382f0a-cba9-474d-b7dd-331e91a97d42 tempest-SnapshotsActionsTest-1528752516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a77d355-26da-4100-9dec-3898dfb27dc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:06:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d2382f0a-cba9-474d-b7dd-331e91a97d42 tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:06 devstack sudo[94471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b 1G Jul 08 01:06:06 devstack sudo[94471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:07 devstack sudo[94471]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d2382f0a-cba9-474d-b7dd-331e91a97d42 tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b 1G" returned: 0 in 0.996s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d2382f0a-cba9-474d-b7dd-331e91a97d42 tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:07 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b Jul 08 01:06:07 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:08 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d2382f0a-cba9-474d-b7dd-331e91a97d42 tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b" returned: 0 in 0.718s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:08 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-d2382f0a-cba9-474d-b7dd-331e91a97d42 tempest-SnapshotsActionsTest-1528752516 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b is being set with open permissions: ugo+rw Jul 08 01:06:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d2382f0a-cba9-474d-b7dd-331e91a97d42 tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:08 devstack sudo[94481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b Jul 08 01:06:08 devstack sudo[94481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:08 devstack sudo[94481]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d2382f0a-cba9-474d-b7dd-331e91a97d42 tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b" returned: 0 in 0.717s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d2382f0a-cba9-474d-b7dd-331e91a97d42 tempest-SnapshotsActionsTest-1528752516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.732s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:06:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-cf2b4fc4-477c-4d0f-b0fa-1c464efc7bf6 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.602s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:06:08 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-cf2b4fc4-477c-4d0f-b0fa-1c464efc7bf6 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Creating offline snapshot ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0 of volume ec062b18-7704-4900-873f-8eeb569a7c55 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:06:08 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-d2382f0a-cba9-474d-b7dd-331e91a97d42 tempest-SnapshotsActionsTest-1528752516 None] Create snapshot completed successfully Jul 08 01:06:08 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ce7ea3-03d7-4077-b798-515150c80133]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:06:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cf2b4fc4-477c-4d0f-b0fa-1c464efc7bf6 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:09 devstack sudo[94518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55 Jul 08 01:06:09 devstack sudo[94518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] Acquiring lock "cinder-ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] Acquiring lock "cinder-quobyte-9a77d355-26da-4100-9dec-3898dfb27dc6" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-quobyte-9a77d355-26da-4100-9dec-3898dfb27dc6" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] Acquiring lock "cinder-quobyte-ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-quobyte-ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] Deleting offline snapshot ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b of volume 9a77d355-26da-4100-9dec-3898dfb27dc6 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:06:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] snapshot_file for this snap is: volume-9a77d355-26da-4100-9dec-3898dfb27dc6.ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:06:09 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[7768dbe7-85c2-4bfe-8051-b65ba03287fe]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:06:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:10 devstack sudo[94522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b Jul 08 01:06:10 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:10 devstack sudo[94518]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cf2b4fc4-477c-4d0f-b0fa-1c464efc7bf6 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55" returned: 0 in 1.507s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cf2b4fc4-477c-4d0f-b0fa-1c464efc7bf6 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0 2G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:10 devstack sudo[94534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0 2G Jul 08 01:06:10 devstack sudo[94534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:11 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b" returned: 0 in 1.433s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a77d355-26da-4100-9dec-3898dfb27dc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:06:11 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2d7dfcc-7392-420a-99ca-52d6b07084a1]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:06:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:11 devstack sudo[94547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 Jul 08 01:06:11 devstack sudo[94547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:11 devstack sudo[94534]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cf2b4fc4-477c-4d0f-b0fa-1c464efc7bf6 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0 2G" returned: 0 in 1.349s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cf2b4fc4-477c-4d0f-b0fa-1c464efc7bf6 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec062b18-7704-4900-873f-8eeb569a7c55 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:11 devstack sudo[94563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec062b18-7704-4900-873f-8eeb569a7c55 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0 Jul 08 01:06:11 devstack sudo[94563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:12 devstack sudo[94547]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71" returned: 0 in 1.040s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a77d355-26da-4100-9dec-3898dfb27dc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:06:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:12 devstack sudo[94593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b Jul 08 01:06:12 devstack sudo[94593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:12 devstack sudo[94563]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cf2b4fc4-477c-4d0f-b0fa-1c464efc7bf6 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec062b18-7704-4900-873f-8eeb569a7c55 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0" returned: 0 in 0.916s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:12 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-cf2b4fc4-477c-4d0f-b0fa-1c464efc7bf6 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0 is being set with open permissions: ugo+rw Jul 08 01:06:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cf2b4fc4-477c-4d0f-b0fa-1c464efc7bf6 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:12 devstack sudo[94598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0 Jul 08 01:06:12 devstack sudo[94598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:13 devstack sudo[94593]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b" returned: 0 in 0.951s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:13 devstack sudo[94603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b Jul 08 01:06:13 devstack sudo[94603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:13 devstack sudo[94598]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cf2b4fc4-477c-4d0f-b0fa-1c464efc7bf6 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0" returned: 0 in 0.801s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cf2b4fc4-477c-4d0f-b0fa-1c464efc7bf6 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:13 devstack sudo[94606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.info Jul 08 01:06:13 devstack sudo[94606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:14 devstack sudo[94603]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b" returned: 0 in 0.772s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-quobyte-ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b" released by "_delete_snapshot" :: held 4.407s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-quobyte-9a77d355-26da-4100-9dec-3898dfb27dc6" released by "delete_snapshot" :: held 4.468s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:14 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] Created reservations ['69f61170-ef0e-4313-bb6c-8b5c94aa947e', 'fa546afd-50e8-4395-858d-8f3ccb685e43', '8152cc3c-0a61-403a-aef6-885d49e750b1', 'edfca854-db40-493d-ad3a-b95646177007'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:06:14 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] Delete snapshot completed successfully. Jul 08 01:06:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e1d46fa6-5a21-4128-85c9-b1f2cde04dd6 tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-ad75bcd2-a4d9-42f1-ba0e-6e7a27d6941b-delete_snapshot" released by "delete_snapshot" :: held 4.666s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:14 devstack sudo[94606]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cf2b4fc4-477c-4d0f-b0fa-1c464efc7bf6 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.info" returned: 0 in 0.823s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:14 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-cf2b4fc4-477c-4d0f-b0fa-1c464efc7bf6 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.info is being set with open permissions: ugo+rw Jul 08 01:06:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cf2b4fc4-477c-4d0f-b0fa-1c464efc7bf6 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:14 devstack sudo[94610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.info Jul 08 01:06:14 devstack sudo[94610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:15 devstack sudo[94610]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cf2b4fc4-477c-4d0f-b0fa-1c464efc7bf6 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.info" returned: 0 in 0.756s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-cf2b4fc4-477c-4d0f-b0fa-1c464efc7bf6 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.349s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:06:15 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-cf2b4fc4-477c-4d0f-b0fa-1c464efc7bf6 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Create snapshot completed successfully Jul 08 01:06:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c8459d4c-4692-4dd3-9046-25d1eb554f2d tempest-SnapshotsActionsTest-1528752516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:06:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c8459d4c-4692-4dd3-9046-25d1eb554f2d tempest-SnapshotsActionsTest-1528752516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:06:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-c8459d4c-4692-4dd3-9046-25d1eb554f2d tempest-SnapshotsActionsTest-1528752516 None] Creating offline snapshot 1bd21efb-c172-4b61-be8a-a30e9386536a of volume 9a77d355-26da-4100-9dec-3898dfb27dc6 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:06:15 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a186d2-b6a8-42a4-86f1-5d23791887b6]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:06:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c8459d4c-4692-4dd3-9046-25d1eb554f2d tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:15 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 Jul 08 01:06:15 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d1152a80-7dbc-41cb-a151-030f31985d7e tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Acquiring lock "cinder-ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d1152a80-7dbc-41cb-a151-030f31985d7e tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Lock "cinder-ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d1152a80-7dbc-41cb-a151-030f31985d7e tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Acquiring lock "cinder-quobyte-ec062b18-7704-4900-873f-8eeb569a7c55" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d1152a80-7dbc-41cb-a151-030f31985d7e tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Lock "cinder-quobyte-ec062b18-7704-4900-873f-8eeb569a7c55" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d1152a80-7dbc-41cb-a151-030f31985d7e tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Acquiring lock "cinder-quobyte-ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d1152a80-7dbc-41cb-a151-030f31985d7e tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Lock "cinder-quobyte-ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-d1152a80-7dbc-41cb-a151-030f31985d7e tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Deleting offline snapshot ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0 of volume ec062b18-7704-4900-873f-8eeb569a7c55 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:06:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-d1152a80-7dbc-41cb-a151-030f31985d7e tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] snapshot_file for this snap is: volume-ec062b18-7704-4900-873f-8eeb569a7c55.ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:06:16 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1036a1a-9995-475e-8283-42901c09544a]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:06:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d1152a80-7dbc-41cb-a151-030f31985d7e tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:16 devstack sudo[94654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0 Jul 08 01:06:16 devstack sudo[94654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:16 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c8459d4c-4692-4dd3-9046-25d1eb554f2d tempest-SnapshotsActionsTest-1528752516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71" returned: 0 in 1.212s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-c8459d4c-4692-4dd3-9046-25d1eb554f2d tempest-SnapshotsActionsTest-1528752516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a77d355-26da-4100-9dec-3898dfb27dc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:06:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c8459d4c-4692-4dd3-9046-25d1eb554f2d tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.1bd21efb-c172-4b61-be8a-a30e9386536a 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:16 devstack sudo[94666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.1bd21efb-c172-4b61-be8a-a30e9386536a 1G Jul 08 01:06:16 devstack sudo[94666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:17 devstack sudo[94654]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d1152a80-7dbc-41cb-a151-030f31985d7e tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0" returned: 0 in 1.198s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-d1152a80-7dbc-41cb-a151-030f31985d7e tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec062b18-7704-4900-873f-8eeb569a7c55(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:06:17 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd5dba0-1b4b-418b-b88b-65a66d5adcb3]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:06:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d1152a80-7dbc-41cb-a151-030f31985d7e tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:17 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55 Jul 08 01:06:17 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:17 devstack sudo[94666]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c8459d4c-4692-4dd3-9046-25d1eb554f2d tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.1bd21efb-c172-4b61-be8a-a30e9386536a 1G" returned: 0 in 1.353s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c8459d4c-4692-4dd3-9046-25d1eb554f2d tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.1bd21efb-c172-4b61-be8a-a30e9386536a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:18 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.1bd21efb-c172-4b61-be8a-a30e9386536a Jul 08 01:06:18 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:18 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d1152a80-7dbc-41cb-a151-030f31985d7e tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55" returned: 0 in 1.180s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d1152a80-7dbc-41cb-a151-030f31985d7e tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:18 devstack sudo[94701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0 Jul 08 01:06:18 devstack sudo[94701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:19 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c8459d4c-4692-4dd3-9046-25d1eb554f2d tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.1bd21efb-c172-4b61-be8a-a30e9386536a" returned: 0 in 1.277s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:19 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-c8459d4c-4692-4dd3-9046-25d1eb554f2d tempest-SnapshotsActionsTest-1528752516 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.1bd21efb-c172-4b61-be8a-a30e9386536a is being set with open permissions: ugo+rw Jul 08 01:06:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c8459d4c-4692-4dd3-9046-25d1eb554f2d tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.1bd21efb-c172-4b61-be8a-a30e9386536a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:19 devstack sudo[94710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.1bd21efb-c172-4b61-be8a-a30e9386536a Jul 08 01:06:19 devstack sudo[94710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:19 devstack sudo[94701]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d1152a80-7dbc-41cb-a151-030f31985d7e tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0" returned: 0 in 1.241s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d1152a80-7dbc-41cb-a151-030f31985d7e tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:19 devstack sudo[94719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0 Jul 08 01:06:19 devstack sudo[94719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:20 devstack sudo[94710]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c8459d4c-4692-4dd3-9046-25d1eb554f2d tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.1bd21efb-c172-4b61-be8a-a30e9386536a" returned: 0 in 1.076s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c8459d4c-4692-4dd3-9046-25d1eb554f2d tempest-SnapshotsActionsTest-1528752516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.051s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:06:20 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-c8459d4c-4692-4dd3-9046-25d1eb554f2d tempest-SnapshotsActionsTest-1528752516 None] Create snapshot completed successfully Jul 08 01:06:20 devstack sudo[94719]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d1152a80-7dbc-41cb-a151-030f31985d7e tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55.ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0" returned: 0 in 1.073s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d1152a80-7dbc-41cb-a151-030f31985d7e tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Lock "cinder-quobyte-ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0" released by "_delete_snapshot" :: held 4.912s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d1152a80-7dbc-41cb-a151-030f31985d7e tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Lock "cinder-quobyte-ec062b18-7704-4900-873f-8eeb569a7c55" released by "delete_snapshot" :: held 4.962s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] Acquiring lock "cinder-1bd21efb-c172-4b61-be8a-a30e9386536a-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-1bd21efb-c172-4b61-be8a-a30e9386536a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.081s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] Acquiring lock "cinder-quobyte-9a77d355-26da-4100-9dec-3898dfb27dc6" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-quobyte-9a77d355-26da-4100-9dec-3898dfb27dc6" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] Acquiring lock "cinder-quobyte-1bd21efb-c172-4b61-be8a-a30e9386536a" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-quobyte-1bd21efb-c172-4b61-be8a-a30e9386536a" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] Deleting offline snapshot 1bd21efb-c172-4b61-be8a-a30e9386536a of volume 9a77d355-26da-4100-9dec-3898dfb27dc6 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:06:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] snapshot_file for this snap is: volume-9a77d355-26da-4100-9dec-3898dfb27dc6.1bd21efb-c172-4b61-be8a-a30e9386536a {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:06:21 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85d6ef8-a05e-4262-92b2-9cf82fce0444]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:06:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.1bd21efb-c172-4b61-be8a-a30e9386536a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:21 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-d1152a80-7dbc-41cb-a151-030f31985d7e tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Created reservations ['0d712c8a-b835-4bd9-b228-c59db9148323', 'ee922e26-e844-401a-8b32-ad19b846ed92', '853a84df-dbcf-4600-98a5-ce46a8dff396', '7d2c2700-37a2-4a5e-a598-96d4211e995f'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:06:21 devstack sudo[94730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.1bd21efb-c172-4b61-be8a-a30e9386536a Jul 08 01:06:21 devstack sudo[94730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:21 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-d1152a80-7dbc-41cb-a151-030f31985d7e tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Delete snapshot completed successfully. Jul 08 01:06:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d1152a80-7dbc-41cb-a151-030f31985d7e tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Lock "cinder-ce5ac80d-c6c4-48e8-b6ee-4c870a2c7fb0-delete_snapshot" released by "delete_snapshot" :: held 5.557s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:22 devstack sudo[94730]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.1bd21efb-c172-4b61-be8a-a30e9386536a" returned: 0 in 1.085s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:22 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a77d355-26da-4100-9dec-3898dfb27dc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:06:22 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[57295be6-f4ca-4fc4-af36-53409234e4fb]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:06:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1be70b0b-9067-41d2-aa5d-e20afdf48ce7 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Acquiring lock "cinder-ec062b18-7704-4900-873f-8eeb569a7c55-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:22 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 Jul 08 01:06:22 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1be70b0b-9067-41d2-aa5d-e20afdf48ce7 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Lock "cinder-ec062b18-7704-4900-873f-8eeb569a7c55-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1be70b0b-9067-41d2-aa5d-e20afdf48ce7 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Acquiring lock "cinder-quobyte-ec062b18-7704-4900-873f-8eeb569a7c55" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1be70b0b-9067-41d2-aa5d-e20afdf48ce7 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Lock "cinder-quobyte-ec062b18-7704-4900-873f-8eeb569a7c55" acquired by "delete_volume" :: waited 0.054s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:22 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-9ac549d0-9cd2-449a-91fa-7f5c4225a738 req-2295b2c2-f2bf-4560-9538-030efb1729a9 tempest-AttachVolumeTestJSON-1636764410 None] Terminate volume connection completed successfully. Jul 08 01:06:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-9ac549d0-9cd2-449a-91fa-7f5c4225a738 req-2295b2c2-f2bf-4560-9538-030efb1729a9 tempest-AttachVolumeTestJSON-1636764410 None] Deleting attachment 6f7591d4-4ba7-4c97-a861-c41f2db71d9e. {{(pid=87123) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:06:22 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[62531965-4ba9-49bb-8ba2-20af121a5897]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:06:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1be70b0b-9067-41d2-aa5d-e20afdf48ce7 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:23 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55 Jul 08 01:06:23 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:23 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71" returned: 0 in 1.268s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a77d355-26da-4100-9dec-3898dfb27dc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:06:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.1bd21efb-c172-4b61-be8a-a30e9386536a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:23 devstack sudo[94751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.1bd21efb-c172-4b61-be8a-a30e9386536a Jul 08 01:06:23 devstack sudo[94751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:24 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1be70b0b-9067-41d2-aa5d-e20afdf48ce7 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55" returned: 0 in 1.227s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1be70b0b-9067-41d2-aa5d-e20afdf48ce7 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:24 devstack sudo[94758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55 Jul 08 01:06:24 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:25 devstack sudo[94751]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.1bd21efb-c172-4b61-be8a-a30e9386536a" returned: 0 in 1.185s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.1bd21efb-c172-4b61-be8a-a30e9386536a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:25 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.1bd21efb-c172-4b61-be8a-a30e9386536a Jul 08 01:06:25 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:25 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1be70b0b-9067-41d2-aa5d-e20afdf48ce7 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec062b18-7704-4900-873f-8eeb569a7c55" returned: 0 in 0.934s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1be70b0b-9067-41d2-aa5d-e20afdf48ce7 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Lock "cinder-quobyte-ec062b18-7704-4900-873f-8eeb569a7c55" released by "delete_volume" :: held 2.237s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:25 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-1be70b0b-9067-41d2-aa5d-e20afdf48ce7 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Created reservations ['aeff602d-f076-4540-a461-e962a5d0e886', 'f92850fa-0cdb-4969-9d1b-23c99be6c631', '8ce905b9-c411-4230-9109-74d2789d7ada', 'bb6664b7-05ad-42c1-882e-ed8a5ce2d42c'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:06:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1be70b0b-9067-41d2-aa5d-e20afdf48ce7 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:06:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1be70b0b-9067-41d2-aa5d-e20afdf48ce7 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:06:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1be70b0b-9067-41d2-aa5d-e20afdf48ce7 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:06:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1be70b0b-9067-41d2-aa5d-e20afdf48ce7 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:06:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1be70b0b-9067-41d2-aa5d-e20afdf48ce7 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:06:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1be70b0b-9067-41d2-aa5d-e20afdf48ce7 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:25 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:06:25 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:25 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.1bd21efb-c172-4b61-be8a-a30e9386536a" returned: 0 in 0.973s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-quobyte-1bd21efb-c172-4b61-be8a-a30e9386536a" released by "_delete_snapshot" :: held 4.720s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-quobyte-9a77d355-26da-4100-9dec-3898dfb27dc6" released by "delete_snapshot" :: held 4.777s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:26 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] Created reservations ['d8119ce5-b750-41ec-875e-cca3dbd6eb29', '1b9b5b1b-e9b0-477f-890f-967f2362f8ff', '158f16cc-0ad8-49f0-b241-a13063528b59', '97e2818a-6e21-40be-88f9-d14e13f87358'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:06:26 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] Delete snapshot completed successfully. Jul 08 01:06:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fac59f5f-b91f-4d9a-96f4-08ec310978ba tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-1bd21efb-c172-4b61-be8a-a30e9386536a-delete_snapshot" released by "delete_snapshot" :: held 5.013s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:26 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1be70b0b-9067-41d2-aa5d-e20afdf48ce7 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.880s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:26 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-1be70b0b-9067-41d2-aa5d-e20afdf48ce7 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:06:26 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-1be70b0b-9067-41d2-aa5d-e20afdf48ce7 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Deleted volume successfully. Jul 08 01:06:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1be70b0b-9067-41d2-aa5d-e20afdf48ce7 tempest-VolumesSnapshotNegativeTestJSON-1554570652 None] Lock "cinder-ec062b18-7704-4900-873f-8eeb569a7c55-delete_volume" released by "delete_volume" :: held 3.535s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-586ce892-c90a-4602-aa72-10695e1d8507 tempest-SnapshotsActionsTest-1528752516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:06:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-586ce892-c90a-4602-aa72-10695e1d8507 tempest-SnapshotsActionsTest-1528752516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:06:26 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-586ce892-c90a-4602-aa72-10695e1d8507 tempest-SnapshotsActionsTest-1528752516 None] Creating offline snapshot 0f7ceae3-8ade-43e0-a32e-c743ab2548fa of volume 9a77d355-26da-4100-9dec-3898dfb27dc6 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:06:27 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1e9dee-7f7c-4f24-94fd-0124b39ed47e]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:06:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-586ce892-c90a-4602-aa72-10695e1d8507 tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:27 devstack sudo[94774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 Jul 08 01:06:27 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:28 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-586ce892-c90a-4602-aa72-10695e1d8507 tempest-SnapshotsActionsTest-1528752516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71" returned: 0 in 1.108s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:28 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-586ce892-c90a-4602-aa72-10695e1d8507 tempest-SnapshotsActionsTest-1528752516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a77d355-26da-4100-9dec-3898dfb27dc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:06:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-586ce892-c90a-4602-aa72-10695e1d8507 tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.0f7ceae3-8ade-43e0-a32e-c743ab2548fa 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:28 devstack sudo[94781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.0f7ceae3-8ade-43e0-a32e-c743ab2548fa 1G Jul 08 01:06:28 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:29 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-586ce892-c90a-4602-aa72-10695e1d8507 tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.0f7ceae3-8ade-43e0-a32e-c743ab2548fa 1G" returned: 0 in 1.069s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-586ce892-c90a-4602-aa72-10695e1d8507 tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.0f7ceae3-8ade-43e0-a32e-c743ab2548fa {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:29 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.0f7ceae3-8ade-43e0-a32e-c743ab2548fa Jul 08 01:06:29 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:30 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-586ce892-c90a-4602-aa72-10695e1d8507 tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.0f7ceae3-8ade-43e0-a32e-c743ab2548fa" returned: 0 in 0.857s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:30 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-586ce892-c90a-4602-aa72-10695e1d8507 tempest-SnapshotsActionsTest-1528752516 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.0f7ceae3-8ade-43e0-a32e-c743ab2548fa is being set with open permissions: ugo+rw Jul 08 01:06:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-586ce892-c90a-4602-aa72-10695e1d8507 tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.0f7ceae3-8ade-43e0-a32e-c743ab2548fa {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:30 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.0f7ceae3-8ade-43e0-a32e-c743ab2548fa Jul 08 01:06:30 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:30 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-586ce892-c90a-4602-aa72-10695e1d8507 tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.0f7ceae3-8ade-43e0-a32e-c743ab2548fa" returned: 0 in 0.880s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-586ce892-c90a-4602-aa72-10695e1d8507 tempest-SnapshotsActionsTest-1528752516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.071s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:06:31 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-586ce892-c90a-4602-aa72-10695e1d8507 tempest-SnapshotsActionsTest-1528752516 None] Create snapshot completed successfully Jul 08 01:06:31 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] Acquiring lock "cinder-0f7ceae3-8ade-43e0-a32e-c743ab2548fa-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:31 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-0f7ceae3-8ade-43e0-a32e-c743ab2548fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:31 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] Acquiring lock "cinder-quobyte-9a77d355-26da-4100-9dec-3898dfb27dc6" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:31 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-quobyte-9a77d355-26da-4100-9dec-3898dfb27dc6" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:31 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] Acquiring lock "cinder-quobyte-0f7ceae3-8ade-43e0-a32e-c743ab2548fa" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:31 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-quobyte-0f7ceae3-8ade-43e0-a32e-c743ab2548fa" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] Deleting offline snapshot 0f7ceae3-8ade-43e0-a32e-c743ab2548fa of volume 9a77d355-26da-4100-9dec-3898dfb27dc6 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:06:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] snapshot_file for this snap is: volume-9a77d355-26da-4100-9dec-3898dfb27dc6.0f7ceae3-8ade-43e0-a32e-c743ab2548fa {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:06:31 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3886ad9-5c86-4f51-9790-f63da83e4bc1]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:06:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.0f7ceae3-8ade-43e0-a32e-c743ab2548fa {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:31 devstack sudo[94796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.0f7ceae3-8ade-43e0-a32e-c743ab2548fa Jul 08 01:06:31 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:32 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.0f7ceae3-8ade-43e0-a32e-c743ab2548fa" returned: 0 in 1.116s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a77d355-26da-4100-9dec-3898dfb27dc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:06:32 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b7837f-624d-419c-a325-fa64c05b680c]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:06:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:32 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 Jul 08 01:06:32 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:33 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71" returned: 0 in 0.981s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a77d355-26da-4100-9dec-3898dfb27dc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:06:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.0f7ceae3-8ade-43e0-a32e-c743ab2548fa {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:33 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.0f7ceae3-8ade-43e0-a32e-c743ab2548fa Jul 08 01:06:33 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:34 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.0f7ceae3-8ade-43e0-a32e-c743ab2548fa" returned: 0 in 0.962s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.0f7ceae3-8ade-43e0-a32e-c743ab2548fa {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:34 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.0f7ceae3-8ade-43e0-a32e-c743ab2548fa Jul 08 01:06:34 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:35 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.0f7ceae3-8ade-43e0-a32e-c743ab2548fa" returned: 0 in 0.690s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:35 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-quobyte-0f7ceae3-8ade-43e0-a32e-c743ab2548fa" released by "_delete_snapshot" :: held 3.872s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:35 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-quobyte-9a77d355-26da-4100-9dec-3898dfb27dc6" released by "delete_snapshot" :: held 3.901s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:38 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] Created reservations ['0c5e235c-6c82-4156-9e99-5c0013578da1', '84ab497f-b9da-44a7-93b8-8a5305e407b4', '0fb9eff0-a127-435e-83dc-8175a6632ba5', '1e5117fc-ba33-4b14-b43c-0408ce31319a'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:06:39 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] Delete snapshot completed successfully. Jul 08 01:06:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dab6704d-1efc-4f20-b2d3-fb6308dd8b14 tempest-SnapshotsActionsTest-1599083079 None] Lock "cinder-0f7ceae3-8ade-43e0-a32e-c743ab2548fa-delete_snapshot" released by "delete_snapshot" :: held 7.801s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f41fa7f1-f314-48e2-ae3d-4f4309ec7953 tempest-SnapshotsActionsTest-1528752516 None] Acquiring lock "cinder-3cdc2b1b-3454-45ef-bef4-f67fb69f9d71-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f41fa7f1-f314-48e2-ae3d-4f4309ec7953 tempest-SnapshotsActionsTest-1528752516 None] Lock "cinder-3cdc2b1b-3454-45ef-bef4-f67fb69f9d71-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f41fa7f1-f314-48e2-ae3d-4f4309ec7953 tempest-SnapshotsActionsTest-1528752516 None] Acquiring lock "cinder-quobyte-9a77d355-26da-4100-9dec-3898dfb27dc6" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f41fa7f1-f314-48e2-ae3d-4f4309ec7953 tempest-SnapshotsActionsTest-1528752516 None] Lock "cinder-quobyte-9a77d355-26da-4100-9dec-3898dfb27dc6" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f41fa7f1-f314-48e2-ae3d-4f4309ec7953 tempest-SnapshotsActionsTest-1528752516 None] Acquiring lock "cinder-quobyte-3cdc2b1b-3454-45ef-bef4-f67fb69f9d71" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f41fa7f1-f314-48e2-ae3d-4f4309ec7953 tempest-SnapshotsActionsTest-1528752516 None] Lock "cinder-quobyte-3cdc2b1b-3454-45ef-bef4-f67fb69f9d71" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f41fa7f1-f314-48e2-ae3d-4f4309ec7953 tempest-SnapshotsActionsTest-1528752516 None] Deleting offline snapshot 3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 of volume 9a77d355-26da-4100-9dec-3898dfb27dc6 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:06:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f41fa7f1-f314-48e2-ae3d-4f4309ec7953 tempest-SnapshotsActionsTest-1528752516 None] snapshot_file for this snap is: volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:06:40 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1162d7-a55e-400c-8c02-95fa1d391137]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:06:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f41fa7f1-f314-48e2-ae3d-4f4309ec7953 tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:40 devstack sudo[94947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 Jul 08 01:06:40 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:42 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f41fa7f1-f314-48e2-ae3d-4f4309ec7953 tempest-SnapshotsActionsTest-1528752516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71" returned: 0 in 1.271s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f41fa7f1-f314-48e2-ae3d-4f4309ec7953 tempest-SnapshotsActionsTest-1528752516 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a77d355-26da-4100-9dec-3898dfb27dc6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:06:42 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[777bbcfc-8955-4b1a-afd6-bcbb33668f9e]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:06:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f41fa7f1-f314-48e2-ae3d-4f4309ec7953 tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:42 devstack sudo[94954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6 Jul 08 01:06:42 devstack sudo[94954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:43 devstack sudo[94954]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f41fa7f1-f314-48e2-ae3d-4f4309ec7953 tempest-SnapshotsActionsTest-1528752516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6" returned: 0 in 1.498s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f41fa7f1-f314-48e2-ae3d-4f4309ec7953 tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:43 devstack sudo[94961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 Jul 08 01:06:43 devstack sudo[94961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:06:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:06:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:06:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:06:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:06:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:06:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:44 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:06:44 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:45 devstack sudo[94961]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f41fa7f1-f314-48e2-ae3d-4f4309ec7953 tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71" returned: 0 in 1.448s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f41fa7f1-f314-48e2-ae3d-4f4309ec7953 tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Flow 'volume_create_manager' (e8ebf014-1217-4236-ad7f-50e07a92e0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:06:45 devstack sudo[94971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71 Jul 08 01:06:45 devstack sudo[94971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b271e59-185d-4602-bda1-ac83a96cfcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b271e59-185d-4602-bda1-ac83a96cfcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-893428986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b47c31-681c-473c-889d-2f1c520f831c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd8b0494e0f49588b32ce1d5a18ef2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:06:45Z,use_quota=True,user_id='83da6367b17d42788b2ce052d834054a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72319e5-32c8-45e0-9d39-1015347bb6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f72319e5-32c8-45e0-9d39-1015347bb6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094c946b-64dd-4353-82bb-fc60a458e7dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094c946b-64dd-4353-82bb-fc60a458e7dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1b47c31-681c-473c-889d-2f1c520f831c', 'volume_name': 'volume-d1b47c31-681c-473c-889d-2f1c520f831c', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757c1479-54e0-4ba1-bc7b-2aa7db99d8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (757c1479-54e0-4ba1-bc7b-2aa7db99d8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e700d4c-8bd1-44b2-b480-e9518e546cf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:06:45 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Volume d1b47c31-681c-473c-889d-2f1c520f831c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1b47c31-681c-473c-889d-2f1c520f831c', 'volume_size': 1} Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:06:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-893428986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b47c31-681c-473c-889d-2f1c520f831c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebd8b0494e0f49588b32ce1d5a18ef2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:06:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:06:45Z,use_quota=True,user_id='83da6367b17d42788b2ce052d834054a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Creating volume d1b47c31-681c-473c-889d-2f1c520f831c {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:06:45 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:06:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d1b47c31-681c-473c-889d-2f1c520f831c 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:45 devstack sudo[94973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d1b47c31-681c-473c-889d-2f1c520f831c 1073741824 Jul 08 01:06:45 devstack sudo[94973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:46 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.132s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:46 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:06:46 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:06:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 8 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:06:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:06:46 devstack sudo[94971]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f41fa7f1-f314-48e2-ae3d-4f4309ec7953 tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6.3cdc2b1b-3454-45ef-bef4-f67fb69f9d71" returned: 0 in 1.286s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f41fa7f1-f314-48e2-ae3d-4f4309ec7953 tempest-SnapshotsActionsTest-1528752516 None] Lock "cinder-quobyte-3cdc2b1b-3454-45ef-bef4-f67fb69f9d71" released by "_delete_snapshot" :: held 5.792s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f41fa7f1-f314-48e2-ae3d-4f4309ec7953 tempest-SnapshotsActionsTest-1528752516 None] Lock "cinder-quobyte-9a77d355-26da-4100-9dec-3898dfb27dc6" released by "delete_snapshot" :: held 5.834s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:46 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-f41fa7f1-f314-48e2-ae3d-4f4309ec7953 tempest-SnapshotsActionsTest-1528752516 None] Created reservations ['a061cffd-5405-4682-85d1-5d948e3118b2', 'e4165e4a-c329-4621-b3e9-4d0af7ea1a69', '417fc1bb-f99e-4374-8942-0614f4b50250', 'ee8d35de-483c-41f0-b4c1-622e09e71e69'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:06:46 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f41fa7f1-f314-48e2-ae3d-4f4309ec7953 tempest-SnapshotsActionsTest-1528752516 None] Delete snapshot completed successfully. Jul 08 01:06:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f41fa7f1-f314-48e2-ae3d-4f4309ec7953 tempest-SnapshotsActionsTest-1528752516 None] Lock "cinder-3cdc2b1b-3454-45ef-bef4-f67fb69f9d71-delete_snapshot" released by "delete_snapshot" :: held 6.108s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:46 devstack sudo[94973]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d1b47c31-681c-473c-889d-2f1c520f831c 1073741824" returned: 0 in 1.536s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d1b47c31-681c-473c-889d-2f1c520f831c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:46 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d1b47c31-681c-473c-889d-2f1c520f831c Jul 08 01:06:46 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3c2c448a-49a6-41c4-8c94-077fa36671ab tempest-SnapshotsActionsTest-1528752516 None] Acquiring lock "cinder-9a77d355-26da-4100-9dec-3898dfb27dc6-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3c2c448a-49a6-41c4-8c94-077fa36671ab tempest-SnapshotsActionsTest-1528752516 None] Lock "cinder-9a77d355-26da-4100-9dec-3898dfb27dc6-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3c2c448a-49a6-41c4-8c94-077fa36671ab tempest-SnapshotsActionsTest-1528752516 None] Acquiring lock "cinder-quobyte-9a77d355-26da-4100-9dec-3898dfb27dc6" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:06:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3c2c448a-49a6-41c4-8c94-077fa36671ab tempest-SnapshotsActionsTest-1528752516 None] Lock "cinder-quobyte-9a77d355-26da-4100-9dec-3898dfb27dc6" acquired by "delete_volume" :: waited 0.022s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:06:47 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[2150b0e7-021c-4a90-877d-d32f5a8458e9]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:06:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3c2c448a-49a6-41c4-8c94-077fa36671ab tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:47 devstack sudo[94983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6 Jul 08 01:06:47 devstack sudo[94983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:48 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d1b47c31-681c-473c-889d-2f1c520f831c" returned: 0 in 1.180s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] <== create_volume: return (2770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:06:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.777s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:06:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e700d4c-8bd1-44b2-b480-e9518e546cf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1b47c31-681c-473c-889d-2f1c520f831c', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:06:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30b5685-0e44-4420-b944-08ec9ead3597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:06:48 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Volume volume-d1b47c31-681c-473c-889d-2f1c520f831c (d1b47c31-681c-473c-889d-2f1c520f831c): created successfully Jul 08 01:06:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30b5685-0e44-4420-b944-08ec9ead3597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:06:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Flow 'volume_create_manager' (e8ebf014-1217-4236-ad7f-50e07a92e0c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:06:48 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-e517d387-27b8-4a14-996a-5bf0903dae4c tempest-AttachVolumeNegativeTest-1707411501 None] Created volume successfully. Jul 08 01:06:48 devstack sudo[94983]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3c2c448a-49a6-41c4-8c94-077fa36671ab tempest-SnapshotsActionsTest-1528752516 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6" returned: 0 in 1.136s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3c2c448a-49a6-41c4-8c94-077fa36671ab tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:48 devstack sudo[94989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6 Jul 08 01:06:48 devstack sudo[94989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:49 devstack sudo[94989]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3c2c448a-49a6-41c4-8c94-077fa36671ab tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a77d355-26da-4100-9dec-3898dfb27dc6" returned: 0 in 0.884s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:49 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3c2c448a-49a6-41c4-8c94-077fa36671ab tempest-SnapshotsActionsTest-1528752516 None] Lock "cinder-quobyte-9a77d355-26da-4100-9dec-3898dfb27dc6" released by "delete_volume" :: held 2.118s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:49 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-3c2c448a-49a6-41c4-8c94-077fa36671ab tempest-SnapshotsActionsTest-1528752516 None] Created reservations ['2891c717-79c9-4d6e-afd7-8d57e3279dab', 'ea528908-3df4-4f20-8db4-6bb2c15f9d39', '416ae0c1-4045-403a-8329-3638eff233aa', '0c1df7f4-4fc7-4ea1-8414-5f905ff27988'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:06:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3c2c448a-49a6-41c4-8c94-077fa36671ab tempest-SnapshotsActionsTest-1528752516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:06:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3c2c448a-49a6-41c4-8c94-077fa36671ab tempest-SnapshotsActionsTest-1528752516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:06:49 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3c2c448a-49a6-41c4-8c94-077fa36671ab tempest-SnapshotsActionsTest-1528752516 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:06:49 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3c2c448a-49a6-41c4-8c94-077fa36671ab tempest-SnapshotsActionsTest-1528752516 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:06:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3c2c448a-49a6-41c4-8c94-077fa36671ab tempest-SnapshotsActionsTest-1528752516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:06:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3c2c448a-49a6-41c4-8c94-077fa36671ab tempest-SnapshotsActionsTest-1528752516 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:49 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:06:49 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:50 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3c2c448a-49a6-41c4-8c94-077fa36671ab tempest-SnapshotsActionsTest-1528752516 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.866s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:50 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-3c2c448a-49a6-41c4-8c94-077fa36671ab tempest-SnapshotsActionsTest-1528752516 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:06:50 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-3c2c448a-49a6-41c4-8c94-077fa36671ab tempest-SnapshotsActionsTest-1528752516 None] Deleted volume successfully. Jul 08 01:06:50 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3c2c448a-49a6-41c4-8c94-077fa36671ab tempest-SnapshotsActionsTest-1528752516 None] Lock "cinder-9a77d355-26da-4100-9dec-3898dfb27dc6-delete_volume" released by "delete_volume" :: held 3.336s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:06:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-2c0180a0-594d-4fe0-966c-515c9401d9d8 req-cd4f4c2d-aad8-4402-827d-785eb0231701 tempest-AttachVolumeNegativeTest-1707411501 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:06:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-2c0180a0-594d-4fe0-966c-515c9401d9d8 req-cd4f4c2d-aad8-4402-827d-785eb0231701 tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:06:52 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e221a91-24ff-4354-bae5-cc9dfc490e70]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:06:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-2c0180a0-594d-4fe0-966c-515c9401d9d8 req-cd4f4c2d-aad8-4402-827d-785eb0231701 tempest-AttachVolumeNegativeTest-1707411501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d1b47c31-681c-473c-889d-2f1c520f831c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:06:53 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d1b47c31-681c-473c-889d-2f1c520f831c Jul 08 01:06:53 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:06:54 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Jul 08 01:06:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-2c0180a0-594d-4fe0-966c-515c9401d9d8 req-cd4f4c2d-aad8-4402-827d-785eb0231701 tempest-AttachVolumeNegativeTest-1707411501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d1b47c31-681c-473c-889d-2f1c520f831c" returned: 0 in 1.259s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:06:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-2c0180a0-594d-4fe0-966c-515c9401d9d8 req-cd4f4c2d-aad8-4402-827d-785eb0231701 tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.291s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:06:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-2c0180a0-594d-4fe0-966c-515c9401d9d8 req-cd4f4c2d-aad8-4402-827d-785eb0231701 tempest-AttachVolumeNegativeTest-1707411501 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e', 'name': 'volume-d1b47c31-681c-473c-889d-2f1c520f831c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00d66ada-edbf-406b-8aee-bd0d5a1fb6b3', 'enforce_multipath': True} {{(pid=87123) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:06:54 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-2c0180a0-594d-4fe0-966c-515c9401d9d8 req-cd4f4c2d-aad8-4402-827d-785eb0231701 tempest-AttachVolumeNegativeTest-1707411501 None] attachment_update completed successfully. Jul 08 01:07:01 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=63,cinder:UPDATE=67,cinder:INSERT=17,cinder:DELETE=2 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:07:01 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-6f4b6d80-f731-4f20-9258-608fd442e430 req-077de54a-5562-4482-98c5-4c3160c89a33 tempest-AttachVolumeNegativeTest-1707411501 None] Terminate volume connection completed successfully. Jul 08 01:07:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-6f4b6d80-f731-4f20-9258-608fd442e430 req-077de54a-5562-4482-98c5-4c3160c89a33 tempest-AttachVolumeNegativeTest-1707411501 None] Deleting attachment 00d66ada-edbf-406b-8aee-bd0d5a1fb6b3. {{(pid=87123) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:07:10 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=60,cinder:INSERT=18,cinder:UPDATE=57,cinder:DELETE=6 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:07:10 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:07:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Flow 'volume_create_manager' (c0bd8f08-c56d-45e7-8ead-ca8d9b3041c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:07:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b9e538-5bcb-45fc-9bf0-bc234b9e27fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55b9e538-5bcb-45fc-9bf0-bc234b9e27fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-165944348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61173be8-a4bc-4fdc-a49e-4bba0c21cace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='832207ae197d491c92b59d5337d5d58b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:07:11Z,use_quota=True,user_id='ab5b11e999384da4bd596c7fef9c040c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080f69cc-a69c-48a4-b403-cf05f9d96d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (080f69cc-a69c-48a4-b403-cf05f9d96d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f95f98e-5780-41a2-8d56-fa00386fffdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f95f98e-5780-41a2-8d56-fa00386fffdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61173be8-a4bc-4fdc-a49e-4bba0c21cace', 'volume_name': 'volume-61173be8-a4bc-4fdc-a49e-4bba0c21cace', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e92e8393-771a-4900-804d-6ebc4e1d328c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e92e8393-771a-4900-804d-6ebc4e1d328c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96d3619-8143-45c6-9cfe-8588d6bde5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:11 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Volume 61173be8-a4bc-4fdc-a49e-4bba0c21cace: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61173be8-a4bc-4fdc-a49e-4bba0c21cace', 'volume_size': 1} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:07:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-165944348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61173be8-a4bc-4fdc-a49e-4bba0c21cace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='832207ae197d491c92b59d5337d5d58b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:07:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:07:11Z,use_quota=True,user_id='ab5b11e999384da4bd596c7fef9c040c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Creating volume 61173be8-a4bc-4fdc-a49e-4bba0c21cace {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:07:11 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61173be8-a4bc-4fdc-a49e-4bba0c21cace 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:11 devstack sudo[95529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61173be8-a4bc-4fdc-a49e-4bba0c21cace 1073741824 Jul 08 01:07:11 devstack sudo[95529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Flow 'volume_create_manager' (908e844a-bfa4-4e49-9372-fb61d947650f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b942e9-97bc-4a43-abbf-4b6b0c67db74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58b942e9-97bc-4a43-abbf-4b6b0c67db74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-87123424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1360cafc-40ba-417c-8b6e-84b9d45031e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='832207ae197d491c92b59d5337d5d58b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:07:12Z,use_quota=True,user_id='ab5b11e999384da4bd596c7fef9c040c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a272214-752c-4e8f-8008-ac234cfe26bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a272214-752c-4e8f-8008-ac234cfe26bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de04c48-29ad-4ffa-a248-a591e7b249dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de04c48-29ad-4ffa-a248-a591e7b249dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1360cafc-40ba-417c-8b6e-84b9d45031e6', 'volume_name': 'volume-1360cafc-40ba-417c-8b6e-84b9d45031e6', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97bd2681-4df1-443b-b0d0-ebb5b3cb7722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97bd2681-4df1-443b-b0d0-ebb5b3cb7722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d79b60-3350-4eee-96e1-9678f7276cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:11 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Volume 1360cafc-40ba-417c-8b6e-84b9d45031e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1360cafc-40ba-417c-8b6e-84b9d45031e6', 'volume_size': 1} Jul 08 01:07:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:12 devstack sudo[95529]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61173be8-a4bc-4fdc-a49e-4bba0c21cace 1073741824" returned: 0 in 1.251s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61173be8-a4bc-4fdc-a49e-4bba0c21cace {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:12 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61173be8-a4bc-4fdc-a49e-4bba0c21cace Jul 08 01:07:12 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:13 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61173be8-a4bc-4fdc-a49e-4bba0c21cace" returned: 0 in 0.998s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] <== create_volume: return (2352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:07:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.357s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:07:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.759s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:07:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-87123424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1360cafc-40ba-417c-8b6e-84b9d45031e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='832207ae197d491c92b59d5337d5d58b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:07:12Z,use_quota=True,user_id='ab5b11e999384da4bd596c7fef9c040c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:07:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Creating volume 1360cafc-40ba-417c-8b6e-84b9d45031e6 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:07:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:07:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:07:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:07:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:07:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:07:13 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:07:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1360cafc-40ba-417c-8b6e-84b9d45031e6 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96d3619-8143-45c6-9cfe-8588d6bde5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61173be8-a4bc-4fdc-a49e-4bba0c21cace', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:13 devstack sudo[95538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1360cafc-40ba-417c-8b6e-84b9d45031e6 1073741824 Jul 08 01:07:13 devstack sudo[95538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8fca68b-da26-4842-8ce8-822d461a3e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:13 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Volume volume-61173be8-a4bc-4fdc-a49e-4bba0c21cace (61173be8-a4bc-4fdc-a49e-4bba0c21cace): created successfully Jul 08 01:07:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8fca68b-da26-4842-8ce8-822d461a3e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Flow 'volume_create_manager' (c0bd8f08-c56d-45e7-8ead-ca8d9b3041c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:07:13 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-d4110f68-28c4-4e28-a22f-462fa29622de tempest-TestServerVolumeAttachmentScenario-1331397985 None] Created volume successfully. Jul 08 01:07:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5c46582c-df44-4dd6-8153-f9254b45c496 tempest-AttachVolumeNegativeTest-1707411501 None] Acquiring lock "cinder-d1b47c31-681c-473c-889d-2f1c520f831c-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:07:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5c46582c-df44-4dd6-8153-f9254b45c496 tempest-AttachVolumeNegativeTest-1707411501 None] Lock "cinder-d1b47c31-681c-473c-889d-2f1c520f831c-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:07:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5c46582c-df44-4dd6-8153-f9254b45c496 tempest-AttachVolumeNegativeTest-1707411501 None] Acquiring lock "cinder-quobyte-d1b47c31-681c-473c-889d-2f1c520f831c" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:07:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5c46582c-df44-4dd6-8153-f9254b45c496 tempest-AttachVolumeNegativeTest-1707411501 None] Lock "cinder-quobyte-d1b47c31-681c-473c-889d-2f1c520f831c" acquired by "delete_volume" :: waited 0.029s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:07:14 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[239332b5-38ee-4c73-ab83-4c87822f51f1]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:07:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c46582c-df44-4dd6-8153-f9254b45c496 tempest-AttachVolumeNegativeTest-1707411501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d1b47c31-681c-473c-889d-2f1c520f831c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:14 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d1b47c31-681c-473c-889d-2f1c520f831c Jul 08 01:07:14 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:14 devstack sudo[95538]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1360cafc-40ba-417c-8b6e-84b9d45031e6 1073741824" returned: 0 in 1.192s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1360cafc-40ba-417c-8b6e-84b9d45031e6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:14 devstack sudo[95547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1360cafc-40ba-417c-8b6e-84b9d45031e6 Jul 08 01:07:14 devstack sudo[95547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:15 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c46582c-df44-4dd6-8153-f9254b45c496 tempest-AttachVolumeNegativeTest-1707411501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d1b47c31-681c-473c-889d-2f1c520f831c" returned: 0 in 1.073s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c46582c-df44-4dd6-8153-f9254b45c496 tempest-AttachVolumeNegativeTest-1707411501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d1b47c31-681c-473c-889d-2f1c520f831c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:15 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d1b47c31-681c-473c-889d-2f1c520f831c Jul 08 01:07:15 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:15 devstack sudo[95547]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1360cafc-40ba-417c-8b6e-84b9d45031e6" returned: 0 in 1.027s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] <== create_volume: return (2275ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:07:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.281s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:07:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d79b60-3350-4eee-96e1-9678f7276cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1360cafc-40ba-417c-8b6e-84b9d45031e6', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e09cab2-b34b-4a16-b6a0-35fe3f3fdcbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:15 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Volume volume-1360cafc-40ba-417c-8b6e-84b9d45031e6 (1360cafc-40ba-417c-8b6e-84b9d45031e6): created successfully Jul 08 01:07:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e09cab2-b34b-4a16-b6a0-35fe3f3fdcbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Flow 'volume_create_manager' (908e844a-bfa4-4e49-9372-fb61d947650f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:07:15 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-44daccf8-25ab-4984-8f39-319bb24413ff tempest-TestServerVolumeAttachmentScenario-1331397985 None] Created volume successfully. Jul 08 01:07:16 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c46582c-df44-4dd6-8153-f9254b45c496 tempest-AttachVolumeNegativeTest-1707411501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d1b47c31-681c-473c-889d-2f1c520f831c" returned: 0 in 0.853s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5c46582c-df44-4dd6-8153-f9254b45c496 tempest-AttachVolumeNegativeTest-1707411501 None] Lock "cinder-quobyte-d1b47c31-681c-473c-889d-2f1c520f831c" released by "delete_volume" :: held 2.006s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:07:16 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-5c46582c-df44-4dd6-8153-f9254b45c496 tempest-AttachVolumeNegativeTest-1707411501 None] Created reservations ['3eff7c6c-d836-42d0-9fa3-ac5c0ca5f753', '9b02079e-9a5a-431e-b943-7904f730998c', '639f3875-09a0-42ad-8edc-5a9fd71319f3', 'd0950800-80fa-4f96-920f-d1c6b1617a21'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:07:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5c46582c-df44-4dd6-8153-f9254b45c496 tempest-AttachVolumeNegativeTest-1707411501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5c46582c-df44-4dd6-8153-f9254b45c496 tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:07:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5c46582c-df44-4dd6-8153-f9254b45c496 tempest-AttachVolumeNegativeTest-1707411501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:07:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5c46582c-df44-4dd6-8153-f9254b45c496 tempest-AttachVolumeNegativeTest-1707411501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:07:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5c46582c-df44-4dd6-8153-f9254b45c496 tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:07:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c46582c-df44-4dd6-8153-f9254b45c496 tempest-AttachVolumeNegativeTest-1707411501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:16 devstack sudo[95556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:07:16 devstack sudo[95556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:17 devstack sudo[95556]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c46582c-df44-4dd6-8153-f9254b45c496 tempest-AttachVolumeNegativeTest-1707411501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.914s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:17 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-5c46582c-df44-4dd6-8153-f9254b45c496 tempest-AttachVolumeNegativeTest-1707411501 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:07:17 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-5c46582c-df44-4dd6-8153-f9254b45c496 tempest-AttachVolumeNegativeTest-1707411501 None] Deleted volume successfully. Jul 08 01:07:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5c46582c-df44-4dd6-8153-f9254b45c496 tempest-AttachVolumeNegativeTest-1707411501 None] Lock "cinder-d1b47c31-681c-473c-889d-2f1c520f831c-delete_volume" released by "delete_volume" :: held 3.514s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:07:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ab34ead8-5c3c-4c8b-ab8d-dd7b95861903 tempest-AttachVolumeNegativeTest-1707411501 None] Acquiring lock "cinder-fb23cee6-2a1c-4961-b27c-445382c45e2b-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:07:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ab34ead8-5c3c-4c8b-ab8d-dd7b95861903 tempest-AttachVolumeNegativeTest-1707411501 None] Lock "cinder-fb23cee6-2a1c-4961-b27c-445382c45e2b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:07:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ab34ead8-5c3c-4c8b-ab8d-dd7b95861903 tempest-AttachVolumeNegativeTest-1707411501 None] Acquiring lock "cinder-quobyte-fb23cee6-2a1c-4961-b27c-445382c45e2b" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:07:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ab34ead8-5c3c-4c8b-ab8d-dd7b95861903 tempest-AttachVolumeNegativeTest-1707411501 None] Lock "cinder-quobyte-fb23cee6-2a1c-4961-b27c-445382c45e2b" acquired by "delete_volume" :: waited 0.038s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:07:18 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[c71b6f78-4d37-4e71-a116-ef35c1df9032]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:07:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ab34ead8-5c3c-4c8b-ab8d-dd7b95861903 tempest-AttachVolumeNegativeTest-1707411501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fb23cee6-2a1c-4961-b27c-445382c45e2b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:18 devstack sudo[95562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fb23cee6-2a1c-4961-b27c-445382c45e2b Jul 08 01:07:18 devstack sudo[95562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:19 devstack sudo[95562]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ab34ead8-5c3c-4c8b-ab8d-dd7b95861903 tempest-AttachVolumeNegativeTest-1707411501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fb23cee6-2a1c-4961-b27c-445382c45e2b" returned: 0 in 1.067s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ab34ead8-5c3c-4c8b-ab8d-dd7b95861903 tempest-AttachVolumeNegativeTest-1707411501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fb23cee6-2a1c-4961-b27c-445382c45e2b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:19 devstack sudo[95568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fb23cee6-2a1c-4961-b27c-445382c45e2b Jul 08 01:07:19 devstack sudo[95568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:20 devstack sudo[95568]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ab34ead8-5c3c-4c8b-ab8d-dd7b95861903 tempest-AttachVolumeNegativeTest-1707411501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fb23cee6-2a1c-4961-b27c-445382c45e2b" returned: 0 in 0.883s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ab34ead8-5c3c-4c8b-ab8d-dd7b95861903 tempest-AttachVolumeNegativeTest-1707411501 None] Lock "cinder-quobyte-fb23cee6-2a1c-4961-b27c-445382c45e2b" released by "delete_volume" :: held 2.059s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:07:20 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-ab34ead8-5c3c-4c8b-ab8d-dd7b95861903 tempest-AttachVolumeNegativeTest-1707411501 None] Created reservations ['beebad80-a7bb-4ecd-b565-b6399a20c8cf', 'bba06e20-08ea-4e1e-96c2-c7741b68c5ec', '9e8266c1-01b9-4a7a-85a6-c5f543d9af9a', '3ce5720b-7e34-4e91-bb29-7ffe93535c85'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:07:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ab34ead8-5c3c-4c8b-ab8d-dd7b95861903 tempest-AttachVolumeNegativeTest-1707411501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ab34ead8-5c3c-4c8b-ab8d-dd7b95861903 tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:07:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ab34ead8-5c3c-4c8b-ab8d-dd7b95861903 tempest-AttachVolumeNegativeTest-1707411501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:07:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ab34ead8-5c3c-4c8b-ab8d-dd7b95861903 tempest-AttachVolumeNegativeTest-1707411501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:07:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ab34ead8-5c3c-4c8b-ab8d-dd7b95861903 tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:07:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ab34ead8-5c3c-4c8b-ab8d-dd7b95861903 tempest-AttachVolumeNegativeTest-1707411501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:20 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:07:20 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-58f99c7a-930c-47a4-b2b6-34db50bbc1bf tempest-AttachVolumeNegativeTest-1707411501 None] Acquiring lock "cinder-db0da99f-59f5-41d7-a017-a66ae4eaf5db-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:07:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-58f99c7a-930c-47a4-b2b6-34db50bbc1bf tempest-AttachVolumeNegativeTest-1707411501 None] Lock "cinder-db0da99f-59f5-41d7-a017-a66ae4eaf5db-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:07:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-58f99c7a-930c-47a4-b2b6-34db50bbc1bf tempest-AttachVolumeNegativeTest-1707411501 None] Acquiring lock "cinder-quobyte-db0da99f-59f5-41d7-a017-a66ae4eaf5db" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:07:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-58f99c7a-930c-47a4-b2b6-34db50bbc1bf tempest-AttachVolumeNegativeTest-1707411501 None] Lock "cinder-quobyte-db0da99f-59f5-41d7-a017-a66ae4eaf5db" acquired by "delete_volume" :: waited 0.038s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:07:21 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ab34ead8-5c3c-4c8b-ab8d-dd7b95861903 tempest-AttachVolumeNegativeTest-1707411501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.008s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:21 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-ab34ead8-5c3c-4c8b-ab8d-dd7b95861903 tempest-AttachVolumeNegativeTest-1707411501 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:07:21 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-ab34ead8-5c3c-4c8b-ab8d-dd7b95861903 tempest-AttachVolumeNegativeTest-1707411501 None] Deleted volume successfully. Jul 08 01:07:21 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[215493fe-7cca-4f86-8a63-70b0eb1355ab]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:07:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-58f99c7a-930c-47a4-b2b6-34db50bbc1bf tempest-AttachVolumeNegativeTest-1707411501 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-db0da99f-59f5-41d7-a017-a66ae4eaf5db {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ab34ead8-5c3c-4c8b-ab8d-dd7b95861903 tempest-AttachVolumeNegativeTest-1707411501 None] Lock "cinder-fb23cee6-2a1c-4961-b27c-445382c45e2b-delete_volume" released by "delete_volume" :: held 3.484s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:07:21 devstack sudo[95581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-db0da99f-59f5-41d7-a017-a66ae4eaf5db Jul 08 01:07:21 devstack sudo[95581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:22 devstack sudo[95581]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-58f99c7a-930c-47a4-b2b6-34db50bbc1bf tempest-AttachVolumeNegativeTest-1707411501 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-db0da99f-59f5-41d7-a017-a66ae4eaf5db" returned: 0 in 0.998s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-58f99c7a-930c-47a4-b2b6-34db50bbc1bf tempest-AttachVolumeNegativeTest-1707411501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-db0da99f-59f5-41d7-a017-a66ae4eaf5db {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:22 devstack sudo[95589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-db0da99f-59f5-41d7-a017-a66ae4eaf5db Jul 08 01:07:22 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:23 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-58f99c7a-930c-47a4-b2b6-34db50bbc1bf tempest-AttachVolumeNegativeTest-1707411501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-db0da99f-59f5-41d7-a017-a66ae4eaf5db" returned: 0 in 1.054s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-58f99c7a-930c-47a4-b2b6-34db50bbc1bf tempest-AttachVolumeNegativeTest-1707411501 None] Lock "cinder-quobyte-db0da99f-59f5-41d7-a017-a66ae4eaf5db" released by "delete_volume" :: held 2.142s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:07:23 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-58f99c7a-930c-47a4-b2b6-34db50bbc1bf tempest-AttachVolumeNegativeTest-1707411501 None] Created reservations ['4aba97ac-e7d7-4348-af2a-1febc40ebc81', '34e52d5b-2bcc-4984-b7fe-a276407f7a80', '369d0063-e098-452d-84c6-49a26189ef2a', '9f06a1fd-bb73-4c3b-b872-4114bbac6018'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:07:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-58f99c7a-930c-47a4-b2b6-34db50bbc1bf tempest-AttachVolumeNegativeTest-1707411501 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-58f99c7a-930c-47a4-b2b6-34db50bbc1bf tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:07:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-58f99c7a-930c-47a4-b2b6-34db50bbc1bf tempest-AttachVolumeNegativeTest-1707411501 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:07:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-58f99c7a-930c-47a4-b2b6-34db50bbc1bf tempest-AttachVolumeNegativeTest-1707411501 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:07:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-58f99c7a-930c-47a4-b2b6-34db50bbc1bf tempest-AttachVolumeNegativeTest-1707411501 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:07:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-58f99c7a-930c-47a4-b2b6-34db50bbc1bf tempest-AttachVolumeNegativeTest-1707411501 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:23 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:07:23 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:24 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-58f99c7a-930c-47a4-b2b6-34db50bbc1bf tempest-AttachVolumeNegativeTest-1707411501 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.880s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:24 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-58f99c7a-930c-47a4-b2b6-34db50bbc1bf tempest-AttachVolumeNegativeTest-1707411501 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:07:24 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-58f99c7a-930c-47a4-b2b6-34db50bbc1bf tempest-AttachVolumeNegativeTest-1707411501 None] Deleted volume successfully. Jul 08 01:07:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-58f99c7a-930c-47a4-b2b6-34db50bbc1bf tempest-AttachVolumeNegativeTest-1707411501 None] Lock "cinder-db0da99f-59f5-41d7-a017-a66ae4eaf5db-delete_volume" released by "delete_volume" :: held 3.392s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:07:33 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=18,cinder:INSERT=10,cinder:UPDATE=30,cinder:DELETE=4 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:07:34 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=20,cinder:UPDATE=29,cinder:INSERT=4,cinder:DELETE=1 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:07:37 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:07:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Flow 'volume_create_manager' (0119912f-6f06-4e88-8a6e-a3b67e4b5f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:07:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da91674e-598d-416a-8199-8d61aa8220b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da91674e-598d-416a-8199-8d61aa8220b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1612520172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02be4b6d-4325-455b-98a7-02e0dfd251b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acb05263ff548fea55256f65475f097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:07:37Z,use_quota=True,user_id='69ed62b43ecf412ab76fe3b323b05739',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e53e1b7b-979d-489f-b92e-ecbced2706ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e53e1b7b-979d-489f-b92e-ecbced2706ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2946e28f-655a-4442-a886-2e373266ad51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2946e28f-655a-4442-a886-2e373266ad51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02be4b6d-4325-455b-98a7-02e0dfd251b7', 'volume_name': 'volume-02be4b6d-4325-455b-98a7-02e0dfd251b7', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73482410-ca72-42ca-a04d-7dccb95b928b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73482410-ca72-42ca-a04d-7dccb95b928b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80dcb377-b8d9-4f31-9f53-11e3243d3199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:37 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Volume 02be4b6d-4325-455b-98a7-02e0dfd251b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02be4b6d-4325-455b-98a7-02e0dfd251b7', 'volume_size': 1} Jul 08 01:07:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:07:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:07:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1612520172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02be4b6d-4325-455b-98a7-02e0dfd251b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4acb05263ff548fea55256f65475f097',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:07:37Z,use_quota=True,user_id='69ed62b43ecf412ab76fe3b323b05739',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:07:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Creating volume 02be4b6d-4325-455b-98a7-02e0dfd251b7 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:07:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:07:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:07:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:07:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:07:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:07:37 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:07:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:37 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7 1073741824 Jul 08 01:07:37 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:39 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7 1073741824" returned: 0 in 2.276s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:39 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7 Jul 08 01:07:39 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:41 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7" returned: 0 in 1.761s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:41 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] <== create_volume: return (4223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:07:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.225s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:07:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80dcb377-b8d9-4f31-9f53-11e3243d3199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02be4b6d-4325-455b-98a7-02e0dfd251b7', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (326df3ed-58b9-47dd-ba7f-f5070f73e6ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:07:41 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Volume volume-02be4b6d-4325-455b-98a7-02e0dfd251b7 (02be4b6d-4325-455b-98a7-02e0dfd251b7): created successfully Jul 08 01:07:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (326df3ed-58b9-47dd-ba7f-f5070f73e6ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:07:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Flow 'volume_create_manager' (0119912f-6f06-4e88-8a6e-a3b67e4b5f06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:07:41 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-5e055166-5909-45e8-a4ec-c57952e04da7 req-2a6a8ecd-b9b1-47bb-87bf-b5970c9d35f4 tempest-VolumesSnapshotsTestJSON-267847286 None] Created volume successfully. Jul 08 01:07:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-f75b317f-c696-424b-a599-0df2709a1ec4 req-2d2c36bd-d6de-4435-8fe8-6356dcb88c1e tempest-VolumesSnapshotsTestJSON-267847286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-f75b317f-c696-424b-a599-0df2709a1ec4 req-2d2c36bd-d6de-4435-8fe8-6356dcb88c1e tempest-VolumesSnapshotsTestJSON-267847286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:07:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [req-f75b317f-c696-424b-a599-0df2709a1ec4 req-2d2c36bd-d6de-4435-8fe8-6356dcb88c1e tempest-VolumesSnapshotsTestJSON-267847286 None] Creating offline snapshot f97afdec-95a2-4b56-9bc8-5ea88c9b51e5 of volume 02be4b6d-4325-455b-98a7-02e0dfd251b7 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:07:42 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b36300f-b7ef-45ba-bdaf-8fdb19ee079b]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:07:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-f75b317f-c696-424b-a599-0df2709a1ec4 req-2d2c36bd-d6de-4435-8fe8-6356dcb88c1e tempest-VolumesSnapshotsTestJSON-267847286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:43 devstack sudo[95774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7 Jul 08 01:07:43 devstack sudo[95774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:44 devstack sudo[95774]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-f75b317f-c696-424b-a599-0df2709a1ec4 req-2d2c36bd-d6de-4435-8fe8-6356dcb88c1e tempest-VolumesSnapshotsTestJSON-267847286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7" returned: 0 in 1.509s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-f75b317f-c696-424b-a599-0df2709a1ec4 req-2d2c36bd-d6de-4435-8fe8-6356dcb88c1e tempest-VolumesSnapshotsTestJSON-267847286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.f97afdec-95a2-4b56-9bc8-5ea88c9b51e5 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:44 devstack sudo[95782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.f97afdec-95a2-4b56-9bc8-5ea88c9b51e5 1G Jul 08 01:07:44 devstack sudo[95782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:07:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:07:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:07:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:07:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:07:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:45 devstack sudo[95785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:07:45 devstack sudo[95785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:46 devstack sudo[95785]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 2.037s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:46 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:07:47 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:07:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 8 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:07:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:07:47 devstack sudo[95782]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-f75b317f-c696-424b-a599-0df2709a1ec4 req-2d2c36bd-d6de-4435-8fe8-6356dcb88c1e tempest-VolumesSnapshotsTestJSON-267847286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.f97afdec-95a2-4b56-9bc8-5ea88c9b51e5 1G" returned: 0 in 2.710s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-f75b317f-c696-424b-a599-0df2709a1ec4 req-2d2c36bd-d6de-4435-8fe8-6356dcb88c1e tempest-VolumesSnapshotsTestJSON-267847286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02be4b6d-4325-455b-98a7-02e0dfd251b7 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.f97afdec-95a2-4b56-9bc8-5ea88c9b51e5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:47 devstack sudo[95792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02be4b6d-4325-455b-98a7-02e0dfd251b7 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.f97afdec-95a2-4b56-9bc8-5ea88c9b51e5 Jul 08 01:07:47 devstack sudo[95792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:48 devstack sudo[95792]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-f75b317f-c696-424b-a599-0df2709a1ec4 req-2d2c36bd-d6de-4435-8fe8-6356dcb88c1e tempest-VolumesSnapshotsTestJSON-267847286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-02be4b6d-4325-455b-98a7-02e0dfd251b7 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.f97afdec-95a2-4b56-9bc8-5ea88c9b51e5" returned: 0 in 1.403s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:48 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [req-f75b317f-c696-424b-a599-0df2709a1ec4 req-2d2c36bd-d6de-4435-8fe8-6356dcb88c1e tempest-VolumesSnapshotsTestJSON-267847286 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.f97afdec-95a2-4b56-9bc8-5ea88c9b51e5 is being set with open permissions: ugo+rw Jul 08 01:07:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-f75b317f-c696-424b-a599-0df2709a1ec4 req-2d2c36bd-d6de-4435-8fe8-6356dcb88c1e tempest-VolumesSnapshotsTestJSON-267847286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.f97afdec-95a2-4b56-9bc8-5ea88c9b51e5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:48 devstack sudo[95797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.f97afdec-95a2-4b56-9bc8-5ea88c9b51e5 Jul 08 01:07:48 devstack sudo[95797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:49 devstack sudo[95797]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-f75b317f-c696-424b-a599-0df2709a1ec4 req-2d2c36bd-d6de-4435-8fe8-6356dcb88c1e tempest-VolumesSnapshotsTestJSON-267847286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.f97afdec-95a2-4b56-9bc8-5ea88c9b51e5" returned: 0 in 1.185s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-f75b317f-c696-424b-a599-0df2709a1ec4 req-2d2c36bd-d6de-4435-8fe8-6356dcb88c1e tempest-VolumesSnapshotsTestJSON-267847286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:49 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.info Jul 08 01:07:49 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:50 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-f75b317f-c696-424b-a599-0df2709a1ec4 req-2d2c36bd-d6de-4435-8fe8-6356dcb88c1e tempest-VolumesSnapshotsTestJSON-267847286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.info" returned: 0 in 0.885s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:50 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [req-f75b317f-c696-424b-a599-0df2709a1ec4 req-2d2c36bd-d6de-4435-8fe8-6356dcb88c1e tempest-VolumesSnapshotsTestJSON-267847286 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.info is being set with open permissions: ugo+rw Jul 08 01:07:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-f75b317f-c696-424b-a599-0df2709a1ec4 req-2d2c36bd-d6de-4435-8fe8-6356dcb88c1e tempest-VolumesSnapshotsTestJSON-267847286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:50 devstack sudo[95844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.info Jul 08 01:07:50 devstack sudo[95844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:51 devstack sudo[95844]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-f75b317f-c696-424b-a599-0df2709a1ec4 req-2d2c36bd-d6de-4435-8fe8-6356dcb88c1e tempest-VolumesSnapshotsTestJSON-267847286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.info" returned: 0 in 0.791s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-f75b317f-c696-424b-a599-0df2709a1ec4 req-2d2c36bd-d6de-4435-8fe8-6356dcb88c1e tempest-VolumesSnapshotsTestJSON-267847286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.729s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:07:51 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-f75b317f-c696-424b-a599-0df2709a1ec4 req-2d2c36bd-d6de-4435-8fe8-6356dcb88c1e tempest-VolumesSnapshotsTestJSON-267847286 None] Create snapshot completed successfully Jul 08 01:07:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-26bab6e3-8b58-4190-b054-11b18bab515c req-da4a1ddc-8040-4634-a23f-235bd230b987 tempest-VolumesSnapshotsTestJSON-267847286 None] Acquiring lock "cinder-f97afdec-95a2-4b56-9bc8-5ea88c9b51e5-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:07:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-26bab6e3-8b58-4190-b054-11b18bab515c req-da4a1ddc-8040-4634-a23f-235bd230b987 tempest-VolumesSnapshotsTestJSON-267847286 None] Lock "cinder-f97afdec-95a2-4b56-9bc8-5ea88c9b51e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:07:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-26bab6e3-8b58-4190-b054-11b18bab515c req-da4a1ddc-8040-4634-a23f-235bd230b987 tempest-VolumesSnapshotsTestJSON-267847286 None] Acquiring lock "cinder-quobyte-02be4b6d-4325-455b-98a7-02e0dfd251b7" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:07:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-26bab6e3-8b58-4190-b054-11b18bab515c req-da4a1ddc-8040-4634-a23f-235bd230b987 tempest-VolumesSnapshotsTestJSON-267847286 None] Lock "cinder-quobyte-02be4b6d-4325-455b-98a7-02e0dfd251b7" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:07:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-26bab6e3-8b58-4190-b054-11b18bab515c req-da4a1ddc-8040-4634-a23f-235bd230b987 tempest-VolumesSnapshotsTestJSON-267847286 None] Acquiring lock "cinder-quobyte-f97afdec-95a2-4b56-9bc8-5ea88c9b51e5" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:07:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-26bab6e3-8b58-4190-b054-11b18bab515c req-da4a1ddc-8040-4634-a23f-235bd230b987 tempest-VolumesSnapshotsTestJSON-267847286 None] Lock "cinder-quobyte-f97afdec-95a2-4b56-9bc8-5ea88c9b51e5" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:07:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [req-26bab6e3-8b58-4190-b054-11b18bab515c req-da4a1ddc-8040-4634-a23f-235bd230b987 tempest-VolumesSnapshotsTestJSON-267847286 None] Deleting offline snapshot f97afdec-95a2-4b56-9bc8-5ea88c9b51e5 of volume 02be4b6d-4325-455b-98a7-02e0dfd251b7 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:07:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [req-26bab6e3-8b58-4190-b054-11b18bab515c req-da4a1ddc-8040-4634-a23f-235bd230b987 tempest-VolumesSnapshotsTestJSON-267847286 None] snapshot_file for this snap is: volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.f97afdec-95a2-4b56-9bc8-5ea88c9b51e5 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:07:52 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6e30d3f-821f-4260-8a5d-dddffe1c8639]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:07:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-26bab6e3-8b58-4190-b054-11b18bab515c req-da4a1ddc-8040-4634-a23f-235bd230b987 tempest-VolumesSnapshotsTestJSON-267847286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.f97afdec-95a2-4b56-9bc8-5ea88c9b51e5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:53 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.f97afdec-95a2-4b56-9bc8-5ea88c9b51e5 Jul 08 01:07:53 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:53 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-26bab6e3-8b58-4190-b054-11b18bab515c req-da4a1ddc-8040-4634-a23f-235bd230b987 tempest-VolumesSnapshotsTestJSON-267847286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.f97afdec-95a2-4b56-9bc8-5ea88c9b51e5" returned: 0 in 1.020s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:53 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [req-26bab6e3-8b58-4190-b054-11b18bab515c req-da4a1ddc-8040-4634-a23f-235bd230b987 tempest-VolumesSnapshotsTestJSON-267847286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-02be4b6d-4325-455b-98a7-02e0dfd251b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:07:53 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e7e9c20-e869-44dd-8187-cdd3ab417d08]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:07:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-26bab6e3-8b58-4190-b054-11b18bab515c req-da4a1ddc-8040-4634-a23f-235bd230b987 tempest-VolumesSnapshotsTestJSON-267847286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:54 devstack sudo[95877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7 Jul 08 01:07:54 devstack sudo[95877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:54 devstack sudo[95877]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-26bab6e3-8b58-4190-b054-11b18bab515c req-da4a1ddc-8040-4634-a23f-235bd230b987 tempest-VolumesSnapshotsTestJSON-267847286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7" returned: 0 in 0.942s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-26bab6e3-8b58-4190-b054-11b18bab515c req-da4a1ddc-8040-4634-a23f-235bd230b987 tempest-VolumesSnapshotsTestJSON-267847286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.f97afdec-95a2-4b56-9bc8-5ea88c9b51e5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:54 devstack sudo[95882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.f97afdec-95a2-4b56-9bc8-5ea88c9b51e5 Jul 08 01:07:54 devstack sudo[95882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:55 devstack sudo[95882]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-26bab6e3-8b58-4190-b054-11b18bab515c req-da4a1ddc-8040-4634-a23f-235bd230b987 tempest-VolumesSnapshotsTestJSON-267847286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.f97afdec-95a2-4b56-9bc8-5ea88c9b51e5" returned: 0 in 0.872s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-26bab6e3-8b58-4190-b054-11b18bab515c req-da4a1ddc-8040-4634-a23f-235bd230b987 tempest-VolumesSnapshotsTestJSON-267847286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.f97afdec-95a2-4b56-9bc8-5ea88c9b51e5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:55 devstack sudo[95887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.f97afdec-95a2-4b56-9bc8-5ea88c9b51e5 Jul 08 01:07:55 devstack sudo[95887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-26bab6e3-8b58-4190-b054-11b18bab515c req-da4a1ddc-8040-4634-a23f-235bd230b987 tempest-VolumesSnapshotsTestJSON-267847286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7.f97afdec-95a2-4b56-9bc8-5ea88c9b51e5" returned: 0 in 0.731s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:56 devstack sudo[95887]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-26bab6e3-8b58-4190-b054-11b18bab515c req-da4a1ddc-8040-4634-a23f-235bd230b987 tempest-VolumesSnapshotsTestJSON-267847286 None] Lock "cinder-quobyte-f97afdec-95a2-4b56-9bc8-5ea88c9b51e5" released by "_delete_snapshot" :: held 3.749s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:07:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-26bab6e3-8b58-4190-b054-11b18bab515c req-da4a1ddc-8040-4634-a23f-235bd230b987 tempest-VolumesSnapshotsTestJSON-267847286 None] Lock "cinder-quobyte-02be4b6d-4325-455b-98a7-02e0dfd251b7" released by "delete_snapshot" :: held 3.792s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:07:56 devstack cinder-volume[87123]: DEBUG cinder.quota [req-26bab6e3-8b58-4190-b054-11b18bab515c req-da4a1ddc-8040-4634-a23f-235bd230b987 tempest-VolumesSnapshotsTestJSON-267847286 None] Created reservations ['aae6391a-c0ec-46f9-943c-5ce93d549b47', 'dc3755d0-68f4-4a8c-9ade-980b3e5c2c35', '69df2a81-0f87-4112-94cb-26a4ef55eb8f', '8f6afdc9-5f82-400f-a38e-e0766b3c5026'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:07:56 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-26bab6e3-8b58-4190-b054-11b18bab515c req-da4a1ddc-8040-4634-a23f-235bd230b987 tempest-VolumesSnapshotsTestJSON-267847286 None] Delete snapshot completed successfully. Jul 08 01:07:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-26bab6e3-8b58-4190-b054-11b18bab515c req-da4a1ddc-8040-4634-a23f-235bd230b987 tempest-VolumesSnapshotsTestJSON-267847286 None] Lock "cinder-f97afdec-95a2-4b56-9bc8-5ea88c9b51e5-delete_snapshot" released by "delete_snapshot" :: held 3.977s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:07:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-094fd1a5-902c-467b-ab21-7fba718003cf req-824ec06c-d137-4685-a936-869d19c3d76e tempest-VolumesSnapshotsTestJSON-267847286 None] Acquiring lock "cinder-02be4b6d-4325-455b-98a7-02e0dfd251b7-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:07:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-094fd1a5-902c-467b-ab21-7fba718003cf req-824ec06c-d137-4685-a936-869d19c3d76e tempest-VolumesSnapshotsTestJSON-267847286 None] Lock "cinder-02be4b6d-4325-455b-98a7-02e0dfd251b7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:07:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-094fd1a5-902c-467b-ab21-7fba718003cf req-824ec06c-d137-4685-a936-869d19c3d76e tempest-VolumesSnapshotsTestJSON-267847286 None] Acquiring lock "cinder-quobyte-02be4b6d-4325-455b-98a7-02e0dfd251b7" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:07:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-094fd1a5-902c-467b-ab21-7fba718003cf req-824ec06c-d137-4685-a936-869d19c3d76e tempest-VolumesSnapshotsTestJSON-267847286 None] Lock "cinder-quobyte-02be4b6d-4325-455b-98a7-02e0dfd251b7" acquired by "delete_volume" :: waited 0.040s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:07:57 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07973f1-fbd9-4f4b-9374-17dd40156e85]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:07:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-094fd1a5-902c-467b-ab21-7fba718003cf req-824ec06c-d137-4685-a936-869d19c3d76e tempest-VolumesSnapshotsTestJSON-267847286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:57 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7 Jul 08 01:07:57 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:58 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-094fd1a5-902c-467b-ab21-7fba718003cf req-824ec06c-d137-4685-a936-869d19c3d76e tempest-VolumesSnapshotsTestJSON-267847286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7" returned: 0 in 0.849s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-094fd1a5-902c-467b-ab21-7fba718003cf req-824ec06c-d137-4685-a936-869d19c3d76e tempest-VolumesSnapshotsTestJSON-267847286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:58 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7 Jul 08 01:07:58 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:58 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-094fd1a5-902c-467b-ab21-7fba718003cf req-824ec06c-d137-4685-a936-869d19c3d76e tempest-VolumesSnapshotsTestJSON-267847286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-02be4b6d-4325-455b-98a7-02e0dfd251b7" returned: 0 in 0.681s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-094fd1a5-902c-467b-ab21-7fba718003cf req-824ec06c-d137-4685-a936-869d19c3d76e tempest-VolumesSnapshotsTestJSON-267847286 None] Lock "cinder-quobyte-02be4b6d-4325-455b-98a7-02e0dfd251b7" released by "delete_volume" :: held 1.609s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:07:59 devstack cinder-volume[87123]: DEBUG cinder.quota [req-094fd1a5-902c-467b-ab21-7fba718003cf req-824ec06c-d137-4685-a936-869d19c3d76e tempest-VolumesSnapshotsTestJSON-267847286 None] Created reservations ['641bdbf3-d067-4282-b429-03d6cb7c1e0a', '8dc23e76-e0ec-4a15-b34f-b8bdeb35b719', 'cf147e28-a970-459d-8713-68f4a5f64882', '61f23978-48f2-4a14-a768-3b77ce8839d4'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:07:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-094fd1a5-902c-467b-ab21-7fba718003cf req-824ec06c-d137-4685-a936-869d19c3d76e tempest-VolumesSnapshotsTestJSON-267847286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:07:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-094fd1a5-902c-467b-ab21-7fba718003cf req-824ec06c-d137-4685-a936-869d19c3d76e tempest-VolumesSnapshotsTestJSON-267847286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:07:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [req-094fd1a5-902c-467b-ab21-7fba718003cf req-824ec06c-d137-4685-a936-869d19c3d76e tempest-VolumesSnapshotsTestJSON-267847286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:07:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [req-094fd1a5-902c-467b-ab21-7fba718003cf req-824ec06c-d137-4685-a936-869d19c3d76e tempest-VolumesSnapshotsTestJSON-267847286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:07:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-094fd1a5-902c-467b-ab21-7fba718003cf req-824ec06c-d137-4685-a936-869d19c3d76e tempest-VolumesSnapshotsTestJSON-267847286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:07:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-094fd1a5-902c-467b-ab21-7fba718003cf req-824ec06c-d137-4685-a936-869d19c3d76e tempest-VolumesSnapshotsTestJSON-267847286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:07:59 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:07:59 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:07:59 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Jul 08 01:07:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-094fd1a5-902c-467b-ab21-7fba718003cf req-824ec06c-d137-4685-a936-869d19c3d76e tempest-VolumesSnapshotsTestJSON-267847286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.708s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:07:59 devstack cinder-volume[87123]: DEBUG cinder.manager [req-094fd1a5-902c-467b-ab21-7fba718003cf req-824ec06c-d137-4685-a936-869d19c3d76e tempest-VolumesSnapshotsTestJSON-267847286 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:07:59 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-094fd1a5-902c-467b-ab21-7fba718003cf req-824ec06c-d137-4685-a936-869d19c3d76e tempest-VolumesSnapshotsTestJSON-267847286 None] Deleted volume successfully. Jul 08 01:07:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-094fd1a5-902c-467b-ab21-7fba718003cf req-824ec06c-d137-4685-a936-869d19c3d76e tempest-VolumesSnapshotsTestJSON-267847286 None] Lock "cinder-02be4b6d-4325-455b-98a7-02e0dfd251b7-delete_volume" released by "delete_volume" :: held 2.646s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:00 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:08:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Flow 'volume_create_manager' (4808a103-733b-45b5-b78c-3c6e033c3fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac20b49c-0171-4038-9245-9f86d212c247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac20b49c-0171-4038-9245-9f86d212c247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1284715499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71702924-33e1-4049-a087-b282a6050fd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='673e0105905a44cf9a282f558a10f713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:00Z,use_quota=True,user_id='550df57a1a3e4c8785af78d800d601f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc8a934-a95a-40df-9903-1b99f54d27ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdc8a934-a95a-40df-9903-1b99f54d27ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233527c5-a01e-40ee-999f-bea878f5de75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (233527c5-a01e-40ee-999f-bea878f5de75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71702924-33e1-4049-a087-b282a6050fd0', 'volume_name': 'volume-71702924-33e1-4049-a087-b282a6050fd0', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d28d75-a48a-4e54-b97f-5e97dfa11746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81d28d75-a48a-4e54-b97f-5e97dfa11746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c11b3940-480a-43e1-9ae9-9e04672ae569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:00 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Volume 71702924-33e1-4049-a087-b282a6050fd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71702924-33e1-4049-a087-b282a6050fd0', 'volume_size': 1} Jul 08 01:08:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1284715499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71702924-33e1-4049-a087-b282a6050fd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='673e0105905a44cf9a282f558a10f713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:00Z,use_quota=True,user_id='550df57a1a3e4c8785af78d800d601f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:08:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Creating volume 71702924-33e1-4049-a087-b282a6050fd0 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:08:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:08:00 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:08:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-71702924-33e1-4049-a087-b282a6050fd0 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:00 devstack sudo[95905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-71702924-33e1-4049-a087-b282a6050fd0 1073741824 Jul 08 01:08:00 devstack sudo[95905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:01 devstack sudo[95905]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-71702924-33e1-4049-a087-b282a6050fd0 1073741824" returned: 0 in 1.243s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-71702924-33e1-4049-a087-b282a6050fd0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:01 devstack sudo[95922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-71702924-33e1-4049-a087-b282a6050fd0 Jul 08 01:08:01 devstack sudo[95922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:02 devstack sudo[95922]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-71702924-33e1-4049-a087-b282a6050fd0" returned: 0 in 1.030s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] <== create_volume: return (2364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:08:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.367s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c11b3940-480a-43e1-9ae9-9e04672ae569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71702924-33e1-4049-a087-b282a6050fd0', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d94b94f-2f26-4f54-9db0-e04bb51e784c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:02 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Volume volume-71702924-33e1-4049-a087-b282a6050fd0 (71702924-33e1-4049-a087-b282a6050fd0): created successfully Jul 08 01:08:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d94b94f-2f26-4f54-9db0-e04bb51e784c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Flow 'volume_create_manager' (4808a103-733b-45b5-b78c-3c6e033c3fbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:02 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-5d8676e1-ac27-432a-8e8f-54b3cbe2470f tempest-VolumesListAdminTestJSON-156950136 None] Created volume successfully. Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Flow 'volume_create_manager' (d8b5984a-6534-49af-afaa-642b25778002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9b2839-c9c4-4a3a-a020-c6d8b7db181c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df9b2839-c9c4-4a3a-a020-c6d8b7db181c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1850960405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c5d8ad-77db-48e1-acb4-509a0c2f8c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='673e0105905a44cf9a282f558a10f713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:04Z,use_quota=True,user_id='550df57a1a3e4c8785af78d800d601f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bdef25-aa06-4986-84b8-608bed983fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6bdef25-aa06-4986-84b8-608bed983fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6acb1b4d-5fdc-4148-95fb-15d6c1b5057a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6acb1b4d-5fdc-4148-95fb-15d6c1b5057a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19c5d8ad-77db-48e1-acb4-509a0c2f8c24', 'volume_name': 'volume-19c5d8ad-77db-48e1-acb4-509a0c2f8c24', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd48f50-4218-4ee2-aa67-4a23d364570d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbd48f50-4218-4ee2-aa67-4a23d364570d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33cab4e5-0ace-4a29-b8b5-f505b4696fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:04 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Volume 19c5d8ad-77db-48e1-acb4-509a0c2f8c24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19c5d8ad-77db-48e1-acb4-509a0c2f8c24', 'volume_size': 1} Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1850960405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19c5d8ad-77db-48e1-acb4-509a0c2f8c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='673e0105905a44cf9a282f558a10f713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:04Z,use_quota=True,user_id='550df57a1a3e4c8785af78d800d601f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Creating volume 19c5d8ad-77db-48e1-acb4-509a0c2f8c24 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:08:04 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-19c5d8ad-77db-48e1-acb4-509a0c2f8c24 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:04 devstack sudo[95931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-19c5d8ad-77db-48e1-acb4-509a0c2f8c24 1073741824 Jul 08 01:08:04 devstack sudo[95931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-2fb5829f-b7e9-4a94-a25b-4511ca338b99 req-d1eea0eb-a1b4-4337-8184-c79ec5a4634f tempest-TestServerVolumeAttachmentScenario-1331397985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:05 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:08:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Flow 'volume_create_manager' (95d2b7d6-512b-4054-9679-bc7506fb7148) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5aa5b7-8455-4a2a-9bb0-bb09a59467a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a5aa5b7-8455-4a2a-9bb0-bb09a59467a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2099298054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3cd2392e84ca4091ac8f97030b22dbb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:05Z,use_quota=True,user_id='76fbfa8962674d899a3c25283b436fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0400e3-c447-4e01-bb21-8b1422729b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc0400e3-c447-4e01-bb21-8b1422729b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644e233d-681e-4b16-9706-ab861f5db34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (644e233d-681e-4b16-9706-ab861f5db34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8', 'volume_name': 'volume-2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f2ba01b-db3f-4055-a9c4-059ac208cfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f2ba01b-db3f-4055-a9c4-059ac208cfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78919407-e355-450b-b762-1ef6083cf976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:05 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Volume 2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8', 'volume_size': 1} Jul 08 01:08:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:05 devstack sudo[95931]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-19c5d8ad-77db-48e1-acb4-509a0c2f8c24 1073741824" returned: 0 in 1.064s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-19c5d8ad-77db-48e1-acb4-509a0c2f8c24 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:05 devstack sudo[95945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-19c5d8ad-77db-48e1-acb4-509a0c2f8c24 Jul 08 01:08:05 devstack sudo[95945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:06 devstack sudo[95945]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-19c5d8ad-77db-48e1-acb4-509a0c2f8c24" returned: 0 in 0.707s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:06 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:08:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.813s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-2fb5829f-b7e9-4a94-a25b-4511ca338b99 req-d1eea0eb-a1b4-4337-8184-c79ec5a4634f tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.568s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33cab4e5-0ace-4a29-b8b5-f505b4696fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19c5d8ad-77db-48e1-acb4-509a0c2f8c24', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775b8e91-2438-4d85-8f3e-13b9ae5f2b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:06 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[69944861-23c4-4adc-ade4-e8003b07ac4f]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-2fb5829f-b7e9-4a94-a25b-4511ca338b99 req-d1eea0eb-a1b4-4337-8184-c79ec5a4634f tempest-TestServerVolumeAttachmentScenario-1331397985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61173be8-a4bc-4fdc-a49e-4bba0c21cace {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:06 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Volume volume-19c5d8ad-77db-48e1-acb4-509a0c2f8c24 (19c5d8ad-77db-48e1-acb4-509a0c2f8c24): created successfully Jul 08 01:08:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (775b8e91-2438-4d85-8f3e-13b9ae5f2b77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Flow 'volume_create_manager' (d8b5984a-6534-49af-afaa-642b25778002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:06 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-c785637f-dfc2-46d6-af18-3de1427d8dbe tempest-VolumesListAdminTestJSON-156950136 None] Created volume successfully. Jul 08 01:08:06 devstack sudo[95950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61173be8-a4bc-4fdc-a49e-4bba0c21cace Jul 08 01:08:06 devstack sudo[95950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:06 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:08:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Flow 'volume_create_manager' (56e80ae2-27ca-4d93-a2b3-7339712a8ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d079b83-d60b-4435-93bd-a7266d971502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d079b83-d60b-4435-93bd-a7266d971502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1397943883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649b9eb9-408b-4d9a-b948-1d910fe3b293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd62ddc1bc3440f9399d30f12c1ac69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:07Z,use_quota=True,user_id='2d8ce5452ccb411592fbdbc080b8a1ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be67a59-391d-45c0-acd7-227ec99c7d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be67a59-391d-45c0-acd7-227ec99c7d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607d1ef5-d4f0-40d8-8d65-81f7a04d0822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (607d1ef5-d4f0-40d8-8d65-81f7a04d0822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '649b9eb9-408b-4d9a-b948-1d910fe3b293', 'volume_name': 'volume-649b9eb9-408b-4d9a-b948-1d910fe3b293', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69133c5c-d016-4d74-af18-472797a5dd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69133c5c-d016-4d74-af18-472797a5dd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d57dd3-70b5-472f-ad1d-9c88034b06cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:07 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Volume 649b9eb9-408b-4d9a-b948-1d910fe3b293: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-649b9eb9-408b-4d9a-b948-1d910fe3b293', 'volume_size': 1} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:07 devstack sudo[95950]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-2fb5829f-b7e9-4a94-a25b-4511ca338b99 req-d1eea0eb-a1b4-4337-8184-c79ec5a4634f tempest-TestServerVolumeAttachmentScenario-1331397985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61173be8-a4bc-4fdc-a49e-4bba0c21cace" returned: 0 in 0.944s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-2fb5829f-b7e9-4a94-a25b-4511ca338b99 req-d1eea0eb-a1b4-4337-8184-c79ec5a4634f tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.969s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.792s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2099298054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3cd2392e84ca4091ac8f97030b22dbb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:05Z,use_quota=True,user_id='76fbfa8962674d899a3c25283b436fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Creating volume 2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:08:07 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:07 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8 1073741824 Jul 08 01:08:07 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-2fb5829f-b7e9-4a94-a25b-4511ca338b99 req-d1eea0eb-a1b4-4337-8184-c79ec5a4634f tempest-TestServerVolumeAttachmentScenario-1331397985 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e', 'name': 'volume-61173be8-a4bc-4fdc-a49e-4bba0c21cace', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc1eb817-f269-47f8-8e1a-d392e2b12882', 'enforce_multipath': True} {{(pid=87123) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:08:07 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-2fb5829f-b7e9-4a94-a25b-4511ca338b99 req-d1eea0eb-a1b4-4337-8184-c79ec5a4634f tempest-TestServerVolumeAttachmentScenario-1331397985 None] attachment_update completed successfully. Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Flow 'volume_create_manager' (788bde2c-f0f1-409e-9676-9229873d3a63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d73b79-e514-47d8-907d-24c4e13c69ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47d73b79-e514-47d8-907d-24c4e13c69ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1833256328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e576309-1764-4ce2-8e73-dd0ef367a1e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='673e0105905a44cf9a282f558a10f713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:08Z,use_quota=True,user_id='550df57a1a3e4c8785af78d800d601f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7200a45c-697a-4098-a7e5-167b8dcf99a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7200a45c-697a-4098-a7e5-167b8dcf99a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12f62a0-89b0-40a4-92c6-d65eb55a0448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f12f62a0-89b0-40a4-92c6-d65eb55a0448) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e576309-1764-4ce2-8e73-dd0ef367a1e6', 'volume_name': 'volume-8e576309-1764-4ce2-8e73-dd0ef367a1e6', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2fc4bd-17f8-47f9-acec-3270e1897e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c2fc4bd-17f8-47f9-acec-3270e1897e80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451610e9-d7ab-4b08-a53a-bcca5c23c07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:07 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Volume 8e576309-1764-4ce2-8e73-dd0ef367a1e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e576309-1764-4ce2-8e73-dd0ef367a1e6', 'volume_size': 1} Jul 08 01:08:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:08 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8 1073741824" returned: 0 in 1.059s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:08 devstack sudo[96028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8 Jul 08 01:08:08 devstack sudo[96028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:09 devstack sudo[96028]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8" returned: 0 in 0.843s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] <== create_volume: return (1950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:08:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.953s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.247s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1397943883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=649b9eb9-408b-4d9a-b948-1d910fe3b293,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd62ddc1bc3440f9399d30f12c1ac69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:07Z,use_quota=True,user_id='2d8ce5452ccb411592fbdbc080b8a1ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:08:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Creating volume 649b9eb9-408b-4d9a-b948-1d910fe3b293 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:08:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:08:09 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:08:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-649b9eb9-408b-4d9a-b948-1d910fe3b293 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78919407-e355-450b-b762-1ef6083cf976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:09 devstack sudo[96346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-649b9eb9-408b-4d9a-b948-1d910fe3b293 1073741824 Jul 08 01:08:09 devstack sudo[96346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432feadb-4a9e-4cb0-805e-cbb69fe391ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:09 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Volume volume-2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8 (2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8): created successfully Jul 08 01:08:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (432feadb-4a9e-4cb0-805e-cbb69fe391ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Flow 'volume_create_manager' (95d2b7d6-512b-4054-9679-bc7506fb7148) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:09 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f065278b-44b8-4b34-97ed-79303fe4b494 tempest-VolumesTestJSON-962083073 None] Created volume successfully. Jul 08 01:08:10 devstack sudo[96346]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-649b9eb9-408b-4d9a-b948-1d910fe3b293 1073741824" returned: 0 in 1.106s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-649b9eb9-408b-4d9a-b948-1d910fe3b293 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:10 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-649b9eb9-408b-4d9a-b948-1d910fe3b293 Jul 08 01:08:10 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:10 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:08:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Flow 'volume_create_manager' (1522d537-6054-4788-a555-60f3079cc147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69051c99-64d6-477d-9f4c-8abbc0d11b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69051c99-64d6-477d-9f4c-8abbc0d11b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-149879309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e65d58-4455-4135-91a9-a7d01cbcbd25,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3cd2392e84ca4091ac8f97030b22dbb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:11Z,use_quota=True,user_id='76fbfa8962674d899a3c25283b436fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481e0d58-e6d3-49ee-8e48-51c72a8e2214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (481e0d58-e6d3-49ee-8e48-51c72a8e2214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eec0227-1ce4-480b-80e0-1acb1bd3861c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9eec0227-1ce4-480b-80e0-1acb1bd3861c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20e65d58-4455-4135-91a9-a7d01cbcbd25', 'volume_name': 'volume-20e65d58-4455-4135-91a9-a7d01cbcbd25', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2f45df-7046-4362-a57f-a14f4c6d4a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a2f45df-7046-4362-a57f-a14f4c6d4a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02082cc7-7d7f-4676-80f8-2ac17896d138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:11 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Volume 20e65d58-4455-4135-91a9-a7d01cbcbd25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20e65d58-4455-4135-91a9-a7d01cbcbd25', 'volume_size': 1} Jul 08 01:08:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:11 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-649b9eb9-408b-4d9a-b948-1d910fe3b293" returned: 0 in 0.850s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] <== create_volume: return (2016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:08:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.633s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1833256328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e576309-1764-4ce2-8e73-dd0ef367a1e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='673e0105905a44cf9a282f558a10f713',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:08Z,use_quota=True,user_id='550df57a1a3e4c8785af78d800d601f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:08:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Creating volume 8e576309-1764-4ce2-8e73-dd0ef367a1e6 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:08:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:08:11 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:08:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8e576309-1764-4ce2-8e73-dd0ef367a1e6 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d57dd3-70b5-472f-ad1d-9c88034b06cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-649b9eb9-408b-4d9a-b948-1d910fe3b293', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13846f1a-3dcb-432f-92f4-67b216d61743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:11 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8e576309-1764-4ce2-8e73-dd0ef367a1e6 1073741824 Jul 08 01:08:11 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:11 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Volume volume-649b9eb9-408b-4d9a-b948-1d910fe3b293 (649b9eb9-408b-4d9a-b948-1d910fe3b293): created successfully Jul 08 01:08:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13846f1a-3dcb-432f-92f4-67b216d61743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Flow 'volume_create_manager' (56e80ae2-27ca-4d93-a2b3-7339712a8ea0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:11 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-1c1c78f4-c124-483a-96be-db00b4683631 tempest-AttachVolumeTestJSON-1636764410 None] Created volume successfully. Jul 08 01:08:12 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8e576309-1764-4ce2-8e73-dd0ef367a1e6 1073741824" returned: 0 in 0.958s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8e576309-1764-4ce2-8e73-dd0ef367a1e6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:12 devstack sudo[96398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8e576309-1764-4ce2-8e73-dd0ef367a1e6 Jul 08 01:08:12 devstack sudo[96398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:13 devstack sudo[96398]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8e576309-1764-4ce2-8e73-dd0ef367a1e6" returned: 0 in 0.749s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:08:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.763s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.066s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-149879309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20e65d58-4455-4135-91a9-a7d01cbcbd25,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3cd2392e84ca4091ac8f97030b22dbb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:11Z,use_quota=True,user_id='76fbfa8962674d899a3c25283b436fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:08:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Creating volume 20e65d58-4455-4135-91a9-a7d01cbcbd25 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:08:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:08:13 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:08:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20e65d58-4455-4135-91a9-a7d01cbcbd25 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:13 devstack sudo[96404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20e65d58-4455-4135-91a9-a7d01cbcbd25 1073741824 Jul 08 01:08:13 devstack sudo[96404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (451610e9-d7ab-4b08-a53a-bcca5c23c07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e576309-1764-4ce2-8e73-dd0ef367a1e6', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77298b0a-2970-4c22-bbe6-ac400f4a248c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:13 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Volume volume-8e576309-1764-4ce2-8e73-dd0ef367a1e6 (8e576309-1764-4ce2-8e73-dd0ef367a1e6): created successfully Jul 08 01:08:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77298b0a-2970-4c22-bbe6-ac400f4a248c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Flow 'volume_create_manager' (788bde2c-f0f1-409e-9676-9229873d3a63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:13 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-ca9c3cf1-7c99-4e47-8247-6b021a782529 tempest-VolumesListAdminTestJSON-156950136 None] Created volume successfully. Jul 08 01:08:14 devstack sudo[96404]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20e65d58-4455-4135-91a9-a7d01cbcbd25 1073741824" returned: 0 in 0.940s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20e65d58-4455-4135-91a9-a7d01cbcbd25 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:14 devstack sudo[96410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20e65d58-4455-4135-91a9-a7d01cbcbd25 Jul 08 01:08:14 devstack sudo[96410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:14 devstack sudo[96410]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20e65d58-4455-4135-91a9-a7d01cbcbd25" returned: 0 in 0.868s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:14 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] <== create_volume: return (1875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:08:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.881s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:14 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02082cc7-7d7f-4676-80f8-2ac17896d138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20e65d58-4455-4135-91a9-a7d01cbcbd25', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:14 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d109785-b27b-4633-a8c3-1963a949e32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:15 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Volume volume-20e65d58-4455-4135-91a9-a7d01cbcbd25 (20e65d58-4455-4135-91a9-a7d01cbcbd25): created successfully Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d109785-b27b-4633-a8c3-1963a949e32b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Flow 'volume_create_manager' (1522d537-6054-4788-a555-60f3079cc147) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:15 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-945aca39-3c09-4672-8d62-def6a96256d9 tempest-VolumesTestJSON-962083073 None] Created volume successfully. Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Flow 'volume_create_manager' (aa5f8d5e-86a3-4dac-91e2-bb318e85d1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aff8c53-a734-4f2a-a0c8-55067b82e4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8aff8c53-a734-4f2a-a0c8-55067b82e4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15126ff-405e-4d72-a2c6-48e2d0b5ac28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267b9a8080c6496886070f8fe84d120b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:15Z,use_quota=True,user_id='a4fa468f45d64054beb3f8ca22e22100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45adbfa-151a-4764-b75d-a7d1c86a34d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d45adbfa-151a-4764-b75d-a7d1c86a34d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd975d82-6809-4631-ab17-b7b1241ed5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd975d82-6809-4631-ab17-b7b1241ed5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f15126ff-405e-4d72-a2c6-48e2d0b5ac28', 'volume_name': 'volume-f15126ff-405e-4d72-a2c6-48e2d0b5ac28', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb2754e2-959d-43cc-bfa9-083c889e8748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb2754e2-959d-43cc-bfa9-083c889e8748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b477d94-42c8-4d5b-a3bc-e02ef1923b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:15 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Volume f15126ff-405e-4d72-a2c6-48e2d0b5ac28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f15126ff-405e-4d72-a2c6-48e2d0b5ac28', 'volume_size': 1} Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15126ff-405e-4d72-a2c6-48e2d0b5ac28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='267b9a8080c6496886070f8fe84d120b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:15Z,use_quota=True,user_id='a4fa468f45d64054beb3f8ca22e22100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Creating volume f15126ff-405e-4d72-a2c6-48e2d0b5ac28 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:08:15 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f15126ff-405e-4d72-a2c6-48e2d0b5ac28 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:15 devstack sudo[96413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f15126ff-405e-4d72-a2c6-48e2d0b5ac28 1073741824 Jul 08 01:08:15 devstack sudo[96413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-ff9415d5-6e44-4408-8597-f4ff6381be29 req-73e29102-915f-4c96-ad0b-d47c963cc968 tempest-AttachVolumeTestJSON-1636764410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:08:16 devstack sudo[96413]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Flow 'volume_create_manager' (95fb58cf-006a-4b76-9d9c-9db5d13481b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f74663-5f2a-4411-8667-da7031210465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f15126ff-405e-4d72-a2c6-48e2d0b5ac28 1073741824" returned: 0 in 0.993s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88f74663-5f2a-4411-8667-da7031210465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-555672040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3cd2392e84ca4091ac8f97030b22dbb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:16Z,use_quota=True,user_id='76fbfa8962674d899a3c25283b436fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd23f000-5148-4920-9d66-69380ab8d47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd23f000-5148-4920-9d66-69380ab8d47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5225042-9cc0-445c-b8cb-d388455697ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5225042-9cc0-445c-b8cb-d388455697ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb', 'volume_name': 'volume-fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3765545c-e7df-4cdc-897f-64e5717bc98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3765545c-e7df-4cdc-897f-64e5717bc98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca0d7bb-c6b4-47f4-a92c-91f001d870e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:16 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Volume fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb', 'volume_size': 1} Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f15126ff-405e-4d72-a2c6-48e2d0b5ac28 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:16 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f15126ff-405e-4d72-a2c6-48e2d0b5ac28 Jul 08 01:08:16 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:16 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f15126ff-405e-4d72-a2c6-48e2d0b5ac28" returned: 0 in 0.617s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] <== create_volume: return (1691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.694s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-ff9415d5-6e44-4408-8597-f4ff6381be29 req-73e29102-915f-4c96-ad0b-d47c963cc968 tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.997s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b477d94-42c8-4d5b-a3bc-e02ef1923b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f15126ff-405e-4d72-a2c6-48e2d0b5ac28', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af96550-2deb-4f36-b89f-0ac3701162c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[5923bb32-c5c9-482a-8f6d-54feb89b827c]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-ff9415d5-6e44-4408-8597-f4ff6381be29 req-73e29102-915f-4c96-ad0b-d47c963cc968 tempest-AttachVolumeTestJSON-1636764410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-649b9eb9-408b-4d9a-b948-1d910fe3b293 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:16 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Volume volume-f15126ff-405e-4d72-a2c6-48e2d0b5ac28 (f15126ff-405e-4d72-a2c6-48e2d0b5ac28): created successfully Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5af96550-2deb-4f36-b89f-0ac3701162c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Flow 'volume_create_manager' (aa5f8d5e-86a3-4dac-91e2-bb318e85d1d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:16 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-d0a3e5c3-dd84-46e1-a85e-585605bb2613 tempest-VolumesListAdminTestJSON-495963014 None] Created volume successfully. Jul 08 01:08:17 devstack sudo[96433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-649b9eb9-408b-4d9a-b948-1d910fe3b293 Jul 08 01:08:17 devstack sudo[96433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5b5ede32-45fa-4431-b599-6ede9ca72083 tempest-VolumesListAdminTestJSON-495963014 None] Acquiring lock "cinder-f15126ff-405e-4d72-a2c6-48e2d0b5ac28-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5b5ede32-45fa-4431-b599-6ede9ca72083 tempest-VolumesListAdminTestJSON-495963014 None] Lock "cinder-f15126ff-405e-4d72-a2c6-48e2d0b5ac28-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5b5ede32-45fa-4431-b599-6ede9ca72083 tempest-VolumesListAdminTestJSON-495963014 None] Acquiring lock "cinder-quobyte-f15126ff-405e-4d72-a2c6-48e2d0b5ac28" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5b5ede32-45fa-4431-b599-6ede9ca72083 tempest-VolumesListAdminTestJSON-495963014 None] Lock "cinder-quobyte-f15126ff-405e-4d72-a2c6-48e2d0b5ac28" acquired by "delete_volume" :: waited 0.027s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[466865bc-2ad4-4e3c-aa70-cb5412bfe5b0]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5b5ede32-45fa-4431-b599-6ede9ca72083 tempest-VolumesListAdminTestJSON-495963014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f15126ff-405e-4d72-a2c6-48e2d0b5ac28 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:17 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f15126ff-405e-4d72-a2c6-48e2d0b5ac28 Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-da32eb9e-b616-49de-a4d5-742502624275 tempest-VolumesListAdminTestJSON-156950136 None] Acquiring lock "cinder-8e576309-1764-4ce2-8e73-dd0ef367a1e6-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:17 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-da32eb9e-b616-49de-a4d5-742502624275 tempest-VolumesListAdminTestJSON-156950136 None] Lock "cinder-8e576309-1764-4ce2-8e73-dd0ef367a1e6-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-da32eb9e-b616-49de-a4d5-742502624275 tempest-VolumesListAdminTestJSON-156950136 None] Acquiring lock "cinder-quobyte-8e576309-1764-4ce2-8e73-dd0ef367a1e6" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-da32eb9e-b616-49de-a4d5-742502624275 tempest-VolumesListAdminTestJSON-156950136 None] Lock "cinder-quobyte-8e576309-1764-4ce2-8e73-dd0ef367a1e6" acquired by "delete_volume" :: waited 0.015s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[9edd0b0f-220e-4534-974c-400392024a1f]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-da32eb9e-b616-49de-a4d5-742502624275 tempest-VolumesListAdminTestJSON-156950136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8e576309-1764-4ce2-8e73-dd0ef367a1e6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:17 devstack sudo[96433]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-ff9415d5-6e44-4408-8597-f4ff6381be29 req-73e29102-915f-4c96-ad0b-d47c963cc968 tempest-AttachVolumeTestJSON-1636764410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-649b9eb9-408b-4d9a-b948-1d910fe3b293" returned: 0 in 0.929s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-ff9415d5-6e44-4408-8597-f4ff6381be29 req-73e29102-915f-4c96-ad0b-d47c963cc968 tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.962s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.612s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-555672040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3cd2392e84ca4091ac8f97030b22dbb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:16Z,use_quota=True,user_id='76fbfa8962674d899a3c25283b436fd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Creating volume fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:08:17 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:17 devstack sudo[96440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8e576309-1764-4ce2-8e73-dd0ef367a1e6 Jul 08 01:08:17 devstack sudo[96440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:17 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb 1073741824 Jul 08 01:08:17 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-ff9415d5-6e44-4408-8597-f4ff6381be29 req-73e29102-915f-4c96-ad0b-d47c963cc968 tempest-AttachVolumeTestJSON-1636764410 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e', 'name': 'volume-649b9eb9-408b-4d9a-b948-1d910fe3b293', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0a30197-60b9-4e5c-b140-ae5e6262ebf1', 'enforce_multipath': True} {{(pid=87123) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:08:17 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-ff9415d5-6e44-4408-8597-f4ff6381be29 req-73e29102-915f-4c96-ad0b-d47c963cc968 tempest-AttachVolumeTestJSON-1636764410 None] attachment_update completed successfully. Jul 08 01:08:18 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5b5ede32-45fa-4431-b599-6ede9ca72083 tempest-VolumesListAdminTestJSON-495963014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f15126ff-405e-4d72-a2c6-48e2d0b5ac28" returned: 0 in 0.979s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5b5ede32-45fa-4431-b599-6ede9ca72083 tempest-VolumesListAdminTestJSON-495963014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f15126ff-405e-4d72-a2c6-48e2d0b5ac28 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:18 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f15126ff-405e-4d72-a2c6-48e2d0b5ac28 Jul 08 01:08:18 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-e0b81635-3108-40f6-b930-2251cdf190df req-070949ef-b026-4788-96ee-60e3a8e17995 tempest-TestServerVolumeAttachmentScenario-1331397985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:18 devstack sudo[96440]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-da32eb9e-b616-49de-a4d5-742502624275 tempest-VolumesListAdminTestJSON-156950136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8e576309-1764-4ce2-8e73-dd0ef367a1e6" returned: 0 in 0.943s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-da32eb9e-b616-49de-a4d5-742502624275 tempest-VolumesListAdminTestJSON-156950136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8e576309-1764-4ce2-8e73-dd0ef367a1e6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:18 devstack sudo[96463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8e576309-1764-4ce2-8e73-dd0ef367a1e6 Jul 08 01:08:18 devstack sudo[96463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:18 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb 1073741824" returned: 0 in 1.056s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:18 devstack sudo[96465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb Jul 08 01:08:18 devstack sudo[96465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:19 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5b5ede32-45fa-4431-b599-6ede9ca72083 tempest-VolumesListAdminTestJSON-495963014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f15126ff-405e-4d72-a2c6-48e2d0b5ac28" returned: 0 in 0.814s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5b5ede32-45fa-4431-b599-6ede9ca72083 tempest-VolumesListAdminTestJSON-495963014 None] Lock "cinder-quobyte-f15126ff-405e-4d72-a2c6-48e2d0b5ac28" released by "delete_volume" :: held 1.839s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-5b5ede32-45fa-4431-b599-6ede9ca72083 tempest-VolumesListAdminTestJSON-495963014 None] Created reservations ['8877154b-da71-4245-a7eb-42eea7340ea6', 'cf00487f-da78-4b6c-80c2-891356c2f736', '028048e0-f0e7-400c-b910-2059b7230e5e', '4690bcb8-203c-4387-a742-5021ceefe819'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5b5ede32-45fa-4431-b599-6ede9ca72083 tempest-VolumesListAdminTestJSON-495963014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5b5ede32-45fa-4431-b599-6ede9ca72083 tempest-VolumesListAdminTestJSON-495963014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5b5ede32-45fa-4431-b599-6ede9ca72083 tempest-VolumesListAdminTestJSON-495963014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5b5ede32-45fa-4431-b599-6ede9ca72083 tempest-VolumesListAdminTestJSON-495963014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5b5ede32-45fa-4431-b599-6ede9ca72083 tempest-VolumesListAdminTestJSON-495963014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5b5ede32-45fa-4431-b599-6ede9ca72083 tempest-VolumesListAdminTestJSON-495963014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:19 devstack sudo[96472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:08:19 devstack sudo[96472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:19 devstack sudo[96463]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-da32eb9e-b616-49de-a4d5-742502624275 tempest-VolumesListAdminTestJSON-156950136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8e576309-1764-4ce2-8e73-dd0ef367a1e6" returned: 0 in 0.820s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-da32eb9e-b616-49de-a4d5-742502624275 tempest-VolumesListAdminTestJSON-156950136 None] Lock "cinder-quobyte-8e576309-1764-4ce2-8e73-dd0ef367a1e6" released by "delete_volume" :: held 1.818s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-da32eb9e-b616-49de-a4d5-742502624275 tempest-VolumesListAdminTestJSON-156950136 None] Created reservations ['209c118e-c28a-4eab-a292-3328b3197b80', '0f8ca1a8-4284-45db-ab26-eee81dd24977', '9c16bc1c-635d-469a-9161-b48c90e96a99', 'b214e22d-c3af-438b-b0bd-50c30056f8b9'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-da32eb9e-b616-49de-a4d5-742502624275 tempest-VolumesListAdminTestJSON-156950136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-da32eb9e-b616-49de-a4d5-742502624275 tempest-VolumesListAdminTestJSON-156950136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-da32eb9e-b616-49de-a4d5-742502624275 tempest-VolumesListAdminTestJSON-156950136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-da32eb9e-b616-49de-a4d5-742502624275 tempest-VolumesListAdminTestJSON-156950136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-da32eb9e-b616-49de-a4d5-742502624275 tempest-VolumesListAdminTestJSON-156950136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-da32eb9e-b616-49de-a4d5-742502624275 tempest-VolumesListAdminTestJSON-156950136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:19 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:08:19 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:19 devstack sudo[96465]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb" returned: 0 in 0.773s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-e0b81635-3108-40f6-b930-2251cdf190df req-070949ef-b026-4788-96ee-60e3a8e17995 tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.251s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca0d7bb-c6b4-47f4-a92c-91f001d870e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b67c90-fee9-41c4-9881-c63ccbd6ef8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[179e7dfc-9309-44cb-b887-666d02b00f58]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-e0b81635-3108-40f6-b930-2251cdf190df req-070949ef-b026-4788-96ee-60e3a8e17995 tempest-TestServerVolumeAttachmentScenario-1331397985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1360cafc-40ba-417c-8b6e-84b9d45031e6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:19 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Volume volume-fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb (fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb): created successfully Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91b67c90-fee9-41c4-9881-c63ccbd6ef8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Flow 'volume_create_manager' (95fb58cf-006a-4b76-9d9c-9db5d13481b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:19 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-5f445263-277d-490e-ba66-595849d5fb0c tempest-VolumesTestJSON-962083073 None] Created volume successfully. Jul 08 01:08:19 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1360cafc-40ba-417c-8b6e-84b9d45031e6 Jul 08 01:08:19 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b8748f61-aeb7-491b-8c51-0b3eb1541a45 tempest-VolumesListAdminTestJSON-156950136 None] Acquiring lock "cinder-19c5d8ad-77db-48e1-acb4-509a0c2f8c24-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:19 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b8748f61-aeb7-491b-8c51-0b3eb1541a45 tempest-VolumesListAdminTestJSON-156950136 None] Lock "cinder-19c5d8ad-77db-48e1-acb4-509a0c2f8c24-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b8748f61-aeb7-491b-8c51-0b3eb1541a45 tempest-VolumesListAdminTestJSON-156950136 None] Acquiring lock "cinder-quobyte-19c5d8ad-77db-48e1-acb4-509a0c2f8c24" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b8748f61-aeb7-491b-8c51-0b3eb1541a45 tempest-VolumesListAdminTestJSON-156950136 None] Lock "cinder-quobyte-19c5d8ad-77db-48e1-acb4-509a0c2f8c24" acquired by "delete_volume" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:20 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[9265da3d-e41e-40d3-801d-8869ed83a112]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b8748f61-aeb7-491b-8c51-0b3eb1541a45 tempest-VolumesListAdminTestJSON-156950136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-19c5d8ad-77db-48e1-acb4-509a0c2f8c24 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:20 devstack sudo[96472]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5b5ede32-45fa-4431-b599-6ede9ca72083 tempest-VolumesListAdminTestJSON-495963014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.893s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:20 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-5b5ede32-45fa-4431-b599-6ede9ca72083 tempest-VolumesListAdminTestJSON-495963014 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:08:20 devstack sudo[96483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-19c5d8ad-77db-48e1-acb4-509a0c2f8c24 Jul 08 01:08:20 devstack sudo[96483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:20 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-5b5ede32-45fa-4431-b599-6ede9ca72083 tempest-VolumesListAdminTestJSON-495963014 None] Deleted volume successfully. Jul 08 01:08:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5b5ede32-45fa-4431-b599-6ede9ca72083 tempest-VolumesListAdminTestJSON-495963014 None] Lock "cinder-f15126ff-405e-4d72-a2c6-48e2d0b5ac28-delete_volume" released by "delete_volume" :: held 3.028s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:20 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-da32eb9e-b616-49de-a4d5-742502624275 tempest-VolumesListAdminTestJSON-156950136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.920s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:20 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-da32eb9e-b616-49de-a4d5-742502624275 tempest-VolumesListAdminTestJSON-156950136 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:08:20 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-da32eb9e-b616-49de-a4d5-742502624275 tempest-VolumesListAdminTestJSON-156950136 None] Deleted volume successfully. Jul 08 01:08:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-da32eb9e-b616-49de-a4d5-742502624275 tempest-VolumesListAdminTestJSON-156950136 None] Lock "cinder-8e576309-1764-4ce2-8e73-dd0ef367a1e6-delete_volume" released by "delete_volume" :: held 2.989s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:20 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-e0b81635-3108-40f6-b930-2251cdf190df req-070949ef-b026-4788-96ee-60e3a8e17995 tempest-TestServerVolumeAttachmentScenario-1331397985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1360cafc-40ba-417c-8b6e-84b9d45031e6" returned: 0 in 0.975s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-e0b81635-3108-40f6-b930-2251cdf190df req-070949ef-b026-4788-96ee-60e3a8e17995 tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-e0b81635-3108-40f6-b930-2251cdf190df req-070949ef-b026-4788-96ee-60e3a8e17995 tempest-TestServerVolumeAttachmentScenario-1331397985 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e', 'name': 'volume-1360cafc-40ba-417c-8b6e-84b9d45031e6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1afb3bf2-bc16-4bf3-8cc8-a7d4601b46c1', 'enforce_multipath': True} {{(pid=87123) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:08:20 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-e0b81635-3108-40f6-b930-2251cdf190df req-070949ef-b026-4788-96ee-60e3a8e17995 tempest-TestServerVolumeAttachmentScenario-1331397985 None] attachment_update completed successfully. Jul 08 01:08:21 devstack sudo[96483]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b8748f61-aeb7-491b-8c51-0b3eb1541a45 tempest-VolumesListAdminTestJSON-156950136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-19c5d8ad-77db-48e1-acb4-509a0c2f8c24" returned: 0 in 1.057s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b8748f61-aeb7-491b-8c51-0b3eb1541a45 tempest-VolumesListAdminTestJSON-156950136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-19c5d8ad-77db-48e1-acb4-509a0c2f8c24 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:21 devstack sudo[96496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-19c5d8ad-77db-48e1-acb4-509a0c2f8c24 Jul 08 01:08:21 devstack sudo[96496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-54815938-1118-4371-89f9-2665d53cf696 tempest-VolumesTestJSON-962083073 None] Acquiring lock "cinder-fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-54815938-1118-4371-89f9-2665d53cf696 tempest-VolumesTestJSON-962083073 None] Lock "cinder-fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-54815938-1118-4371-89f9-2665d53cf696 tempest-VolumesTestJSON-962083073 None] Acquiring lock "cinder-quobyte-fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-54815938-1118-4371-89f9-2665d53cf696 tempest-VolumesTestJSON-962083073 None] Lock "cinder-quobyte-fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb" acquired by "delete_volume" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:21 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c4e5b0-d9c4-4d0f-9e91-8fbef7522646]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-54815938-1118-4371-89f9-2665d53cf696 tempest-VolumesTestJSON-962083073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:21 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb Jul 08 01:08:21 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:21 devstack sudo[96496]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b8748f61-aeb7-491b-8c51-0b3eb1541a45 tempest-VolumesListAdminTestJSON-156950136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-19c5d8ad-77db-48e1-acb4-509a0c2f8c24" returned: 0 in 0.713s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b8748f61-aeb7-491b-8c51-0b3eb1541a45 tempest-VolumesListAdminTestJSON-156950136 None] Lock "cinder-quobyte-19c5d8ad-77db-48e1-acb4-509a0c2f8c24" released by "delete_volume" :: held 1.829s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:21 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-b8748f61-aeb7-491b-8c51-0b3eb1541a45 tempest-VolumesListAdminTestJSON-156950136 None] Created reservations ['ec1dedd2-edb8-4ec7-a352-9a348f89e221', '0b67b454-29f6-4cba-b026-cbdefdd69f5e', 'f6f28250-a363-4cfa-ab6a-4a67bb83e521', '854fe6cb-a22e-4ddc-b7eb-b727d74ad027'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:08:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b8748f61-aeb7-491b-8c51-0b3eb1541a45 tempest-VolumesListAdminTestJSON-156950136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b8748f61-aeb7-491b-8c51-0b3eb1541a45 tempest-VolumesListAdminTestJSON-156950136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:22 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b8748f61-aeb7-491b-8c51-0b3eb1541a45 tempest-VolumesListAdminTestJSON-156950136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:22 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b8748f61-aeb7-491b-8c51-0b3eb1541a45 tempest-VolumesListAdminTestJSON-156950136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b8748f61-aeb7-491b-8c51-0b3eb1541a45 tempest-VolumesListAdminTestJSON-156950136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b8748f61-aeb7-491b-8c51-0b3eb1541a45 tempest-VolumesListAdminTestJSON-156950136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:22 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:08:22 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-429b02b2-be71-486f-bd58-51d726bb3dad tempest-VolumesListAdminTestJSON-156950136 None] Acquiring lock "cinder-71702924-33e1-4049-a087-b282a6050fd0-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-429b02b2-be71-486f-bd58-51d726bb3dad tempest-VolumesListAdminTestJSON-156950136 None] Lock "cinder-71702924-33e1-4049-a087-b282a6050fd0-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:22 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-54815938-1118-4371-89f9-2665d53cf696 tempest-VolumesTestJSON-962083073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb" returned: 0 in 0.983s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-54815938-1118-4371-89f9-2665d53cf696 tempest-VolumesTestJSON-962083073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:22 devstack sudo[96509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb Jul 08 01:08:22 devstack sudo[96509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-429b02b2-be71-486f-bd58-51d726bb3dad tempest-VolumesListAdminTestJSON-156950136 None] Acquiring lock "cinder-quobyte-71702924-33e1-4049-a087-b282a6050fd0" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-429b02b2-be71-486f-bd58-51d726bb3dad tempest-VolumesListAdminTestJSON-156950136 None] Lock "cinder-quobyte-71702924-33e1-4049-a087-b282a6050fd0" acquired by "delete_volume" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:22 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ba0f91-676d-4379-838f-839a07b59941]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-429b02b2-be71-486f-bd58-51d726bb3dad tempest-VolumesListAdminTestJSON-156950136 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-71702924-33e1-4049-a087-b282a6050fd0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:22 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-71702924-33e1-4049-a087-b282a6050fd0 Jul 08 01:08:22 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:22 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b8748f61-aeb7-491b-8c51-0b3eb1541a45 tempest-VolumesListAdminTestJSON-156950136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.847s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:22 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-b8748f61-aeb7-491b-8c51-0b3eb1541a45 tempest-VolumesListAdminTestJSON-156950136 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:08:22 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b8748f61-aeb7-491b-8c51-0b3eb1541a45 tempest-VolumesListAdminTestJSON-156950136 None] Deleted volume successfully. Jul 08 01:08:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b8748f61-aeb7-491b-8c51-0b3eb1541a45 tempest-VolumesListAdminTestJSON-156950136 None] Lock "cinder-19c5d8ad-77db-48e1-acb4-509a0c2f8c24-delete_volume" released by "delete_volume" :: held 3.015s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Flow 'volume_create_manager' (0a97bb47-86d7-4c10-9923-5fb1af19ba19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea6392d-e03d-4d54-9123-a399709ac797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cea6392d-e03d-4d54-9123-a399709ac797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-780839795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de0be54-1cde-4921-9c15-4ec20ed03275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd62ddc1bc3440f9399d30f12c1ac69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:23Z,use_quota=True,user_id='2d8ce5452ccb411592fbdbc080b8a1ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21748b0-a7f2-4d93-90ae-656c76089306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a21748b0-a7f2-4d93-90ae-656c76089306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2376962-1ab6-4793-80d2-9aa0c110cba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2376962-1ab6-4793-80d2-9aa0c110cba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4de0be54-1cde-4921-9c15-4ec20ed03275', 'volume_name': 'volume-4de0be54-1cde-4921-9c15-4ec20ed03275', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd606ef0-0e8f-4850-a3ae-9e6d3487e778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd606ef0-0e8f-4850-a3ae-9e6d3487e778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375b15f3-cdfb-41c7-8248-e7bb35bc8b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:23 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Volume 4de0be54-1cde-4921-9c15-4ec20ed03275: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4de0be54-1cde-4921-9c15-4ec20ed03275', 'volume_size': 1} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-780839795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de0be54-1cde-4921-9c15-4ec20ed03275,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cd62ddc1bc3440f9399d30f12c1ac69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:23Z,use_quota=True,user_id='2d8ce5452ccb411592fbdbc080b8a1ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Creating volume 4de0be54-1cde-4921-9c15-4ec20ed03275 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:08:23 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4de0be54-1cde-4921-9c15-4ec20ed03275 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:23 devstack sudo[96515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4de0be54-1cde-4921-9c15-4ec20ed03275 1073741824 Jul 08 01:08:23 devstack sudo[96515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:23 devstack sudo[96509]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-54815938-1118-4371-89f9-2665d53cf696 tempest-VolumesTestJSON-962083073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb" returned: 0 in 0.913s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-54815938-1118-4371-89f9-2665d53cf696 tempest-VolumesTestJSON-962083073 None] Lock "cinder-quobyte-fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb" released by "delete_volume" :: held 1.936s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-54815938-1118-4371-89f9-2665d53cf696 tempest-VolumesTestJSON-962083073 None] Created reservations ['e083325a-797d-4cfc-a59c-9315d45d33b3', '77267e53-c7fd-4baa-a8d7-0eeca3507482', 'a09444fe-f43d-4561-abc0-cb7dce92e0d2', 'ba7da31d-4680-4f1e-9448-96ea26b7db28'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-54815938-1118-4371-89f9-2665d53cf696 tempest-VolumesTestJSON-962083073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-54815938-1118-4371-89f9-2665d53cf696 tempest-VolumesTestJSON-962083073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-54815938-1118-4371-89f9-2665d53cf696 tempest-VolumesTestJSON-962083073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-54815938-1118-4371-89f9-2665d53cf696 tempest-VolumesTestJSON-962083073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-54815938-1118-4371-89f9-2665d53cf696 tempest-VolumesTestJSON-962083073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-54815938-1118-4371-89f9-2665d53cf696 tempest-VolumesTestJSON-962083073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:23 devstack sudo[96520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:08:23 devstack sudo[96520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:23 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-429b02b2-be71-486f-bd58-51d726bb3dad tempest-VolumesListAdminTestJSON-156950136 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-71702924-33e1-4049-a087-b282a6050fd0" returned: 0 in 1.004s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-429b02b2-be71-486f-bd58-51d726bb3dad tempest-VolumesListAdminTestJSON-156950136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-71702924-33e1-4049-a087-b282a6050fd0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:23 devstack sudo[96522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-71702924-33e1-4049-a087-b282a6050fd0 Jul 08 01:08:23 devstack sudo[96522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f2b19e4b-7e26-48ba-8a70-ab3134b3ef44 tempest-VolumesTestJSON-962083073 None] Acquiring lock "cinder-20e65d58-4455-4135-91a9-a7d01cbcbd25-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f2b19e4b-7e26-48ba-8a70-ab3134b3ef44 tempest-VolumesTestJSON-962083073 None] Lock "cinder-20e65d58-4455-4135-91a9-a7d01cbcbd25-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f2b19e4b-7e26-48ba-8a70-ab3134b3ef44 tempest-VolumesTestJSON-962083073 None] Acquiring lock "cinder-quobyte-20e65d58-4455-4135-91a9-a7d01cbcbd25" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f2b19e4b-7e26-48ba-8a70-ab3134b3ef44 tempest-VolumesTestJSON-962083073 None] Lock "cinder-quobyte-20e65d58-4455-4135-91a9-a7d01cbcbd25" acquired by "delete_volume" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[066dee84-8d9b-49db-ad6f-f70109239fff]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f2b19e4b-7e26-48ba-8a70-ab3134b3ef44 tempest-VolumesTestJSON-962083073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20e65d58-4455-4135-91a9-a7d01cbcbd25 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:23 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20e65d58-4455-4135-91a9-a7d01cbcbd25 Jul 08 01:08:23 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:24 devstack sudo[96522]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-429b02b2-be71-486f-bd58-51d726bb3dad tempest-VolumesListAdminTestJSON-156950136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-71702924-33e1-4049-a087-b282a6050fd0" returned: 0 in 0.906s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:24 devstack sudo[96520]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-429b02b2-be71-486f-bd58-51d726bb3dad tempest-VolumesListAdminTestJSON-156950136 None] Lock "cinder-quobyte-71702924-33e1-4049-a087-b282a6050fd0" released by "delete_volume" :: held 1.982s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-54815938-1118-4371-89f9-2665d53cf696 tempest-VolumesTestJSON-962083073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.990s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:24 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-54815938-1118-4371-89f9-2665d53cf696 tempest-VolumesTestJSON-962083073 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:08:24 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-54815938-1118-4371-89f9-2665d53cf696 tempest-VolumesTestJSON-962083073 None] Deleted volume successfully. Jul 08 01:08:24 devstack sudo[96515]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4de0be54-1cde-4921-9c15-4ec20ed03275 1073741824" returned: 0 in 1.302s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-54815938-1118-4371-89f9-2665d53cf696 tempest-VolumesTestJSON-962083073 None] Lock "cinder-fe0e6327-29f9-4aa7-8d51-4a5e0198a4cb-delete_volume" released by "delete_volume" :: held 3.188s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4de0be54-1cde-4921-9c15-4ec20ed03275 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:24 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-429b02b2-be71-486f-bd58-51d726bb3dad tempest-VolumesListAdminTestJSON-156950136 None] Created reservations ['f9524f4c-2f83-416f-9a1f-5fae1e3ce89a', '0dc0862d-222f-490d-88af-bf087882ef67', '3b8ca1e3-f2b9-4718-aa1e-f9061ea47157', '4b50aee0-f89e-42f9-8b1c-b1e5483b9c61'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:08:24 devstack sudo[96532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4de0be54-1cde-4921-9c15-4ec20ed03275 Jul 08 01:08:24 devstack sudo[96532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-429b02b2-be71-486f-bd58-51d726bb3dad tempest-VolumesListAdminTestJSON-156950136 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-429b02b2-be71-486f-bd58-51d726bb3dad tempest-VolumesListAdminTestJSON-156950136 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-429b02b2-be71-486f-bd58-51d726bb3dad tempest-VolumesListAdminTestJSON-156950136 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-429b02b2-be71-486f-bd58-51d726bb3dad tempest-VolumesListAdminTestJSON-156950136 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-429b02b2-be71-486f-bd58-51d726bb3dad tempest-VolumesListAdminTestJSON-156950136 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-429b02b2-be71-486f-bd58-51d726bb3dad tempest-VolumesListAdminTestJSON-156950136 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:24 devstack sudo[96536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:08:24 devstack sudo[96536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:25 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f2b19e4b-7e26-48ba-8a70-ab3134b3ef44 tempest-VolumesTestJSON-962083073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20e65d58-4455-4135-91a9-a7d01cbcbd25" returned: 0 in 1.141s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f2b19e4b-7e26-48ba-8a70-ab3134b3ef44 tempest-VolumesTestJSON-962083073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20e65d58-4455-4135-91a9-a7d01cbcbd25 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:25 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20e65d58-4455-4135-91a9-a7d01cbcbd25 Jul 08 01:08:25 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:25 devstack sudo[96532]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4de0be54-1cde-4921-9c15-4ec20ed03275" returned: 0 in 0.891s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] <== create_volume: return (2282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:08:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.286s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:25 devstack sudo[96536]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (375b15f3-cdfb-41c7-8248-e7bb35bc8b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de0be54-1cde-4921-9c15-4ec20ed03275', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c1ae1e-28f8-4ca5-b33e-e4879d60f102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-429b02b2-be71-486f-bd58-51d726bb3dad tempest-VolumesListAdminTestJSON-156950136 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.801s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:25 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-429b02b2-be71-486f-bd58-51d726bb3dad tempest-VolumesListAdminTestJSON-156950136 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:08:25 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-429b02b2-be71-486f-bd58-51d726bb3dad tempest-VolumesListAdminTestJSON-156950136 None] Deleted volume successfully. Jul 08 01:08:25 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Volume volume-4de0be54-1cde-4921-9c15-4ec20ed03275 (4de0be54-1cde-4921-9c15-4ec20ed03275): created successfully Jul 08 01:08:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c1ae1e-28f8-4ca5-b33e-e4879d60f102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Flow 'volume_create_manager' (0a97bb47-86d7-4c10-9923-5fb1af19ba19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:25 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-1ad4d411-eddb-4006-b09d-c47d0093c61e tempest-AttachVolumeTestJSON-1636764410 None] Created volume successfully. Jul 08 01:08:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-429b02b2-be71-486f-bd58-51d726bb3dad tempest-VolumesListAdminTestJSON-156950136 None] Lock "cinder-71702924-33e1-4049-a087-b282a6050fd0-delete_volume" released by "delete_volume" :: held 3.175s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:25 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f2b19e4b-7e26-48ba-8a70-ab3134b3ef44 tempest-VolumesTestJSON-962083073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20e65d58-4455-4135-91a9-a7d01cbcbd25" returned: 0 in 0.782s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f2b19e4b-7e26-48ba-8a70-ab3134b3ef44 tempest-VolumesTestJSON-962083073 None] Lock "cinder-quobyte-20e65d58-4455-4135-91a9-a7d01cbcbd25" released by "delete_volume" :: held 1.969s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:25 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-f2b19e4b-7e26-48ba-8a70-ab3134b3ef44 tempest-VolumesTestJSON-962083073 None] Created reservations ['d7b33946-07ba-4425-9ed7-6b26be57e1b8', 'cb0dec40-195f-4078-8a01-e9030343943e', '5cfb03db-8d80-4e27-b9c7-40cecba65fda', 'ae324a2b-8402-4028-8e9d-f38368127933'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:08:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f2b19e4b-7e26-48ba-8a70-ab3134b3ef44 tempest-VolumesTestJSON-962083073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f2b19e4b-7e26-48ba-8a70-ab3134b3ef44 tempest-VolumesTestJSON-962083073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f2b19e4b-7e26-48ba-8a70-ab3134b3ef44 tempest-VolumesTestJSON-962083073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f2b19e4b-7e26-48ba-8a70-ab3134b3ef44 tempest-VolumesTestJSON-962083073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f2b19e4b-7e26-48ba-8a70-ab3134b3ef44 tempest-VolumesTestJSON-962083073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f2b19e4b-7e26-48ba-8a70-ab3134b3ef44 tempest-VolumesTestJSON-962083073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:25 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:08:25 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:26 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-878a5a91-a5b1-494a-a39a-dedc0ca1033d req-4d579a46-4e7d-4019-a336-671be2e2f412 tempest-TestServerVolumeAttachmentScenario-1331397985 None] Terminate volume connection completed successfully. Jul 08 01:08:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-878a5a91-a5b1-494a-a39a-dedc0ca1033d req-4d579a46-4e7d-4019-a336-671be2e2f412 tempest-TestServerVolumeAttachmentScenario-1331397985 None] Deleting attachment 1afb3bf2-bc16-4bf3-8cc8-a7d4601b46c1. {{(pid=87123) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:08:26 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f2b19e4b-7e26-48ba-8a70-ab3134b3ef44 tempest-VolumesTestJSON-962083073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.765s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:26 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-f2b19e4b-7e26-48ba-8a70-ab3134b3ef44 tempest-VolumesTestJSON-962083073 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:08:26 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f2b19e4b-7e26-48ba-8a70-ab3134b3ef44 tempest-VolumesTestJSON-962083073 None] Deleted volume successfully. Jul 08 01:08:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f2b19e4b-7e26-48ba-8a70-ab3134b3ef44 tempest-VolumesTestJSON-962083073 None] Lock "cinder-20e65d58-4455-4135-91a9-a7d01cbcbd25-delete_volume" released by "delete_volume" :: held 3.027s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:27 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0b0f97e2-1623-406b-a5ec-12ae15be45fa tempest-VolumesTestJSON-962083073 None] Acquiring lock "cinder-2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:27 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0b0f97e2-1623-406b-a5ec-12ae15be45fa tempest-VolumesTestJSON-962083073 None] Lock "cinder-2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:27 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0b0f97e2-1623-406b-a5ec-12ae15be45fa tempest-VolumesTestJSON-962083073 None] Acquiring lock "cinder-quobyte-2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:27 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0b0f97e2-1623-406b-a5ec-12ae15be45fa tempest-VolumesTestJSON-962083073 None] Lock "cinder-quobyte-2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8" acquired by "delete_volume" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:27 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd61964-2e04-4ef6-a426-2afb6c8bdd9a]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0b0f97e2-1623-406b-a5ec-12ae15be45fa tempest-VolumesTestJSON-962083073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:27 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8 Jul 08 01:08:27 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:28 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0b0f97e2-1623-406b-a5ec-12ae15be45fa tempest-VolumesTestJSON-962083073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8" returned: 0 in 0.846s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0b0f97e2-1623-406b-a5ec-12ae15be45fa tempest-VolumesTestJSON-962083073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:28 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8 Jul 08 01:08:28 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:28 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0b0f97e2-1623-406b-a5ec-12ae15be45fa tempest-VolumesTestJSON-962083073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8" returned: 0 in 0.858s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0b0f97e2-1623-406b-a5ec-12ae15be45fa tempest-VolumesTestJSON-962083073 None] Lock "cinder-quobyte-2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8" released by "delete_volume" :: held 1.754s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:28 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-0b0f97e2-1623-406b-a5ec-12ae15be45fa tempest-VolumesTestJSON-962083073 None] Created reservations ['9eaa8c5b-52ac-4482-948d-1c1f4359d1a6', 'e5ac9079-ce11-4d47-8d31-bfbadc261a0a', '19402c3e-1a9b-4bca-9677-d4439d985aa9', 'b158052b-42b7-41c9-9518-ee2cd60d4169'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:08:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0b0f97e2-1623-406b-a5ec-12ae15be45fa tempest-VolumesTestJSON-962083073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0b0f97e2-1623-406b-a5ec-12ae15be45fa tempest-VolumesTestJSON-962083073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:29 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0b0f97e2-1623-406b-a5ec-12ae15be45fa tempest-VolumesTestJSON-962083073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:29 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0b0f97e2-1623-406b-a5ec-12ae15be45fa tempest-VolumesTestJSON-962083073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0b0f97e2-1623-406b-a5ec-12ae15be45fa tempest-VolumesTestJSON-962083073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0b0f97e2-1623-406b-a5ec-12ae15be45fa tempest-VolumesTestJSON-962083073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:29 devstack sudo[96585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:08:29 devstack sudo[96585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-1e25d656-3193-4ffc-ad94-0873250a47da req-c49f6932-1545-4fee-bbad-90ac64ef3cb3 tempest-AttachVolumeTestJSON-1636764410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-1e25d656-3193-4ffc-ad94-0873250a47da req-c49f6932-1545-4fee-bbad-90ac64ef3cb3 tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:29 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[78186e1d-3831-4f01-a464-325bdf65fbac]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-1e25d656-3193-4ffc-ad94-0873250a47da req-c49f6932-1545-4fee-bbad-90ac64ef3cb3 tempest-AttachVolumeTestJSON-1636764410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4de0be54-1cde-4921-9c15-4ec20ed03275 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:29 devstack sudo[96595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4de0be54-1cde-4921-9c15-4ec20ed03275 Jul 08 01:08:29 devstack sudo[96595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:30 devstack sudo[96585]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0b0f97e2-1623-406b-a5ec-12ae15be45fa tempest-VolumesTestJSON-962083073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.906s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:30 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-0b0f97e2-1623-406b-a5ec-12ae15be45fa tempest-VolumesTestJSON-962083073 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:08:30 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-0b0f97e2-1623-406b-a5ec-12ae15be45fa tempest-VolumesTestJSON-962083073 None] Deleted volume successfully. Jul 08 01:08:30 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0b0f97e2-1623-406b-a5ec-12ae15be45fa tempest-VolumesTestJSON-962083073 None] Lock "cinder-2b2cd0e0-39f1-4333-ac40-3a875a3fb1c8-delete_volume" released by "delete_volume" :: held 3.020s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:30 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-c3cf4259-19c8-4cd7-8648-8f7f66b45e47 req-efbf9dbe-64d7-465e-9e29-fb43882059b1 tempest-TestServerVolumeAttachmentScenario-1331397985 None] Terminate volume connection completed successfully. Jul 08 01:08:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-c3cf4259-19c8-4cd7-8648-8f7f66b45e47 req-efbf9dbe-64d7-465e-9e29-fb43882059b1 tempest-TestServerVolumeAttachmentScenario-1331397985 None] Deleting attachment bc1eb817-f269-47f8-8e1a-d392e2b12882. {{(pid=87123) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:08:30 devstack sudo[96595]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-1e25d656-3193-4ffc-ad94-0873250a47da req-c49f6932-1545-4fee-bbad-90ac64ef3cb3 tempest-AttachVolumeTestJSON-1636764410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4de0be54-1cde-4921-9c15-4ec20ed03275" returned: 0 in 1.060s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-1e25d656-3193-4ffc-ad94-0873250a47da req-c49f6932-1545-4fee-bbad-90ac64ef3cb3 tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.097s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-1e25d656-3193-4ffc-ad94-0873250a47da req-c49f6932-1545-4fee-bbad-90ac64ef3cb3 tempest-AttachVolumeTestJSON-1636764410 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e', 'name': 'volume-4de0be54-1cde-4921-9c15-4ec20ed03275', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8835225-5d0f-45a5-9803-f91a3bf2846d', 'enforce_multipath': True} {{(pid=87123) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:08:30 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-1e25d656-3193-4ffc-ad94-0873250a47da req-c49f6932-1545-4fee-bbad-90ac64ef3cb3 tempest-AttachVolumeTestJSON-1636764410 None] attachment_update completed successfully. Jul 08 01:08:31 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:08:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Flow 'volume_create_manager' (d9bf67ef-d525-4d86-b0a7-42ad68a64144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078b601c-f95d-4fd6-96ee-7aca4af2271d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (078b601c-f95d-4fd6-96ee-7aca4af2271d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1094332588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34fd45e3-effe-4b7b-9412-b395a5a0ab0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5654310fa61043fcacc652241b9eb44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:32Z,use_quota=True,user_id='c51d8843e21a49f0b9dfbc0c998af4f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6abf14c3-ba8d-4b08-917a-cc038485a0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6abf14c3-ba8d-4b08-917a-cc038485a0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a0dbe3-9234-42b7-9b4d-c0bf9c254030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:32 devstack cinder-volume[87123]: DEBUG cinder.image.glance [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Creating Keystone auth plugin from conf {{(pid=87123) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:08:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a0dbe3-9234-42b7-9b4d-c0bf9c254030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '34fd45e3-effe-4b7b-9412-b395a5a0ab0c', 'volume_name': 'volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c', 'volume_size': 1, 'image_id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '464063acafa44f9e90fd1bca62b64e8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'created_at': datetime.datetime(2026, 7, 7, 22, 51, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 51, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e8643e-df30-4f90-b3a5-0f137bdca5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81e8643e-df30-4f90-b3a5-0f137bdca5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0bb4cef-5ac1-4d0e-9900-f002b7505d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:32 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Volume 34fd45e3-effe-4b7b-9412-b395a5a0ab0c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c', 'volume_size': 1, 'image_id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '464063acafa44f9e90fd1bca62b64e8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'created_at': datetime.datetime(2026, 7, 7, 22, 51, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 51, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 01:08:32 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Trying to clone 34fd45e3-effe-4b7b-9412-b395a5a0ab0c from image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d at location (None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}]). {{(pid=87123) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:08:33 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_bpashbjjdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:08:33 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Image download 20.69 MB at 20.69 MB/s Jul 08 01:08:33 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[46711255-684f-4623-88ab-0c82253a7ef2]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_bpashbjjdevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:33 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_bpashbjjdevstack@QuobyteHD Jul 08 01:08:33 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:34 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_bpashbjjdevstack@QuobyteHD" returned: 0 in 0.916s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:34 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Temporary image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d is fetched for user c51d8843e21a49f0b9dfbc0c998af4f5. {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:08:34 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=93,cinder:UPDATE=105,cinder:INSERT=21,cinder:DELETE=11 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:08:34 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[01726581-9bde-4323-9d82-a92b1766426e]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_bpashbjjdevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:34 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:UPDATE=110,cinder:SELECT=98,cinder:DELETE=8,cinder:INSERT=27 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:08:34 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-a2dcab35-6657-4d87-99d0-119d8b1c8e15 tempest-GroupSnapshotsV319Test-388167599 None] Group tempest-GroupSnapshotsV319Test-Group-351511249: creating Jul 08 01:08:34 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-a2dcab35-6657-4d87-99d0-119d8b1c8e15 tempest-GroupSnapshotsV319Test-388167599 None] Group tempest-GroupSnapshotsV319Test-Group-351511249: created successfully Jul 08 01:08:34 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-a2dcab35-6657-4d87-99d0-119d8b1c8e15 tempest-GroupSnapshotsV319Test-388167599 None] Create group completed successfully. Jul 08 01:08:34 devstack sudo[96637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_bpashbjjdevstack@QuobyteHD Jul 08 01:08:34 devstack sudo[96637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:35 devstack sudo[96637]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_bpashbjjdevstack@QuobyteHD" returned: 0 in 1.343s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1094332588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34fd45e3-effe-4b7b-9412-b395a5a0ab0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5654310fa61043fcacc652241b9eb44f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:32Z,use_quota=True,user_id='c51d8843e21a49f0b9dfbc0c998af4f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:08:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Creating volume 34fd45e3-effe-4b7b-9412-b395a5a0ab0c {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:08:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:08:35 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:08:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:35 devstack sudo[96661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c 1073741824 Jul 08 01:08:35 devstack sudo[96661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:36 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:08:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Flow 'volume_create_manager' (dbc5cc71-da32-4d13-af3d-954c2597a2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd87aac-a88e-4613-b60a-b3d996e11d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcd87aac-a88e-4613-b60a-b3d996e11d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-673991852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9dbd1d2a-14a1-4de2-9a92-d4f9546543d7,host='devstack@QuobyteHD#QuobyteHD',id=bce0f674-aa0c-460e-af7f-6f23282888da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58e53df6ead741169d64250154c99e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:36Z,use_quota=True,user_id='04c04194edb74b05bf1d2718eef5f627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f8366d8-2c83-43fe-81b2-e61e5dab7e18),volume_type_id=1f8366d8-2c83-43fe-81b2-e61e5dab7e18)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1d6434-880c-42e7-b0e1-db24e6651f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1d6434-880c-42e7-b0e1-db24e6651f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adfba9d6-0f3e-44d5-855d-c2267527c127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adfba9d6-0f3e-44d5-855d-c2267527c127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bce0f674-aa0c-460e-af7f-6f23282888da', 'volume_name': 'volume-bce0f674-aa0c-460e-af7f-6f23282888da', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fecf5c73-a050-4229-9d75-abe4bb9b0bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fecf5c73-a050-4229-9d75-abe4bb9b0bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ed6252-c017-4dd0-9dd8-156886862764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:36 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Volume bce0f674-aa0c-460e-af7f-6f23282888da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bce0f674-aa0c-460e-af7f-6f23282888da', 'volume_size': 1} Jul 08 01:08:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:36 devstack sudo[96661]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c 1073741824" returned: 0 in 1.085s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:36 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-b209a1dc-3da2-4f81-9053-8f1a96fb5d89 req-c1bc5672-41f9-496c-b72c-5f87239a3ac8 tempest-AttachVolumeTestJSON-1636764410 None] Terminate volume connection completed successfully. Jul 08 01:08:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-b209a1dc-3da2-4f81-9053-8f1a96fb5d89 req-c1bc5672-41f9-496c-b72c-5f87239a3ac8 tempest-AttachVolumeTestJSON-1636764410 None] Deleting attachment e0a30197-60b9-4e5c-b140-ae5e6262ebf1. {{(pid=87123) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:08:36 devstack sudo[96672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c Jul 08 01:08:36 devstack sudo[96672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:37 devstack sudo[96672]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c" returned: 0 in 0.670s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:08:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.143s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9dbd1d2a-14a1-4de2-9a92-d4f9546543d7,created_at=2026-07-07T23:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-673991852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9dbd1d2a-14a1-4de2-9a92-d4f9546543d7,host='devstack@QuobyteHD#QuobyteHD',id=bce0f674-aa0c-460e-af7f-6f23282888da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58e53df6ead741169d64250154c99e7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:36Z,use_quota=True,user_id='04c04194edb74b05bf1d2718eef5f627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f8366d8-2c83-43fe-81b2-e61e5dab7e18),volume_type_id=1f8366d8-2c83-43fe-81b2-e61e5dab7e18)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:08:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Creating volume bce0f674-aa0c-460e-af7f-6f23282888da {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:08:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:08:37 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:08:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:37 devstack sudo[96675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da 1073741824 Jul 08 01:08:37 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:37 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Attempting download of 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d ((None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}])) to volume 34fd45e3-effe-4b7b-9412-b395a5a0ab0c. {{(pid=87123) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:08:37 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb81a829-62e5-4cad-99eb-0afc729e3ff3]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_ae1yyx65 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:37 devstack sudo[96677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_ae1yyx65 Jul 08 01:08:37 devstack sudo[96677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:38 devstack sudo[96677]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_ae1yyx65" returned: 0 in 0.881s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_ae1yyx65 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:38 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da 1073741824" returned: 0 in 0.991s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:38 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da Jul 08 01:08:38 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:38 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_ae1yyx65 Jul 08 01:08:38 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:39 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_ae1yyx65" returned: 1 in 0.813s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_ae1yyx65' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:08:39 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f136b1-40d5-4b2c-823f-c19f1e509694]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_bpashbjjdevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:39 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da" returned: 0 in 0.829s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:39 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] <== create_volume: return (1869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:08:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.873s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ed6252-c017-4dd0-9dd8-156886862764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bce0f674-aa0c-460e-af7f-6f23282888da', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfaed624-fb87-4dd1-9c04-e5ef1461e396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:39 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Volume volume-bce0f674-aa0c-460e-af7f-6f23282888da (bce0f674-aa0c-460e-af7f-6f23282888da): created successfully Jul 08 01:08:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfaed624-fb87-4dd1-9c04-e5ef1461e396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:39 devstack sudo[96691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_bpashbjjdevstack@QuobyteHD Jul 08 01:08:39 devstack sudo[96691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Flow 'volume_create_manager' (dbc5cc71-da32-4d13-af3d-954c2597a2d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:39 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-9c2f36ce-aefe-4dc5-abf6-684c7c9b6fa7 tempest-GroupSnapshotsV319Test-388167599 None] Created volume successfully. Jul 08 01:08:39 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-a81b0436-a8e3-4e35-a5d9-0a59e3d90407 req-22407c05-40a8-47c7-850a-355b3380a854 tempest-AttachVolumeTestJSON-1636764410 None] Terminate volume connection completed successfully. Jul 08 01:08:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-a81b0436-a8e3-4e35-a5d9-0a59e3d90407 req-22407c05-40a8-47c7-850a-355b3380a854 tempest-AttachVolumeTestJSON-1636764410 None] Deleting attachment e8835225-5d0f-45a5-9803-f91a3bf2846d. {{(pid=87123) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:08:40 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f6d41e48-1e71-49ef-8e4a-21886664b92c tempest-GroupSnapshotsV319Test-388167599 None] GroupSnapshot 88509e68-ea2f-4fad-9d56-d5220573a589: creating. Jul 08 01:08:40 devstack sudo[96691]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_bpashbjjdevstack@QuobyteHD" returned: 0 in 0.895s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:40 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d was qcow2, converting to raw {{(pid=87123) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:08:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_bpashbjjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6d41e48-1e71-49ef-8e4a-21886664b92c tempest-GroupSnapshotsV319Test-388167599 None] Group snapshot 88509e68-ea2f-4fad-9d56-d5220573a589: creating. {{(pid=87123) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 08 01:08:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f6d41e48-1e71-49ef-8e4a-21886664b92c tempest-GroupSnapshotsV319Test-388167599 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f6d41e48-1e71-49ef-8e4a-21886664b92c tempest-GroupSnapshotsV319Test-388167599 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:40 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_bpashbjjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c Jul 08 01:08:40 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f6d41e48-1e71-49ef-8e4a-21886664b92c tempest-GroupSnapshotsV319Test-388167599 None] Creating offline snapshot 20e91439-e895-4b2f-8392-a54ad4d2ba7f of volume bce0f674-aa0c-460e-af7f-6f23282888da {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:08:40 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[55247330-c548-4361-821d-71beaa43b932]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6d41e48-1e71-49ef-8e4a-21886664b92c tempest-GroupSnapshotsV319Test-388167599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:40 devstack sudo[96704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da Jul 08 01:08:40 devstack sudo[96704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:41 devstack sudo[96704]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6d41e48-1e71-49ef-8e4a-21886664b92c tempest-GroupSnapshotsV319Test-388167599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da" returned: 0 in 0.999s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6d41e48-1e71-49ef-8e4a-21886664b92c tempest-GroupSnapshotsV319Test-388167599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.20e91439-e895-4b2f-8392-a54ad4d2ba7f 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:41 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.20e91439-e895-4b2f-8392-a54ad4d2ba7f 1G Jul 08 01:08:41 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:41 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0520921d-9b13-4924-bd9d-42a3093e68ac tempest-TestServerVolumeAttachmentScenario-1331397985 None] Acquiring lock "cinder-1360cafc-40ba-417c-8b6e-84b9d45031e6-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:41 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0520921d-9b13-4924-bd9d-42a3093e68ac tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "cinder-1360cafc-40ba-417c-8b6e-84b9d45031e6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:41 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0520921d-9b13-4924-bd9d-42a3093e68ac tempest-TestServerVolumeAttachmentScenario-1331397985 None] Acquiring lock "cinder-quobyte-1360cafc-40ba-417c-8b6e-84b9d45031e6" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:41 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0520921d-9b13-4924-bd9d-42a3093e68ac tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "cinder-quobyte-1360cafc-40ba-417c-8b6e-84b9d45031e6" acquired by "delete_volume" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:41 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6b97c74-9775-4474-9555-206a59c8157f]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0520921d-9b13-4924-bd9d-42a3093e68ac tempest-TestServerVolumeAttachmentScenario-1331397985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1360cafc-40ba-417c-8b6e-84b9d45031e6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:42 devstack sudo[96721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1360cafc-40ba-417c-8b6e-84b9d45031e6 Jul 08 01:08:42 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:42 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6d41e48-1e71-49ef-8e4a-21886664b92c tempest-GroupSnapshotsV319Test-388167599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.20e91439-e895-4b2f-8392-a54ad4d2ba7f 1G" returned: 0 in 1.131s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6d41e48-1e71-49ef-8e4a-21886664b92c tempest-GroupSnapshotsV319Test-388167599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bce0f674-aa0c-460e-af7f-6f23282888da -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.20e91439-e895-4b2f-8392-a54ad4d2ba7f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:42 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bce0f674-aa0c-460e-af7f-6f23282888da -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.20e91439-e895-4b2f-8392-a54ad4d2ba7f Jul 08 01:08:42 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:43 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_bpashbjjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c" returned: 0 in 2.729s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:43 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_bpashbjjdevstack@QuobyteHD, size 112.00 MB, duration 2.73 sec, destination /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:08:43 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Converted 112.00 MB image at 41.00 MB/s Jul 08 01:08:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:43 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0520921d-9b13-4924-bd9d-42a3093e68ac tempest-TestServerVolumeAttachmentScenario-1331397985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1360cafc-40ba-417c-8b6e-84b9d45031e6" returned: 0 in 1.119s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0520921d-9b13-4924-bd9d-42a3093e68ac tempest-TestServerVolumeAttachmentScenario-1331397985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1360cafc-40ba-417c-8b6e-84b9d45031e6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:43 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c 1G Jul 08 01:08:43 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:43 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1360cafc-40ba-417c-8b6e-84b9d45031e6 Jul 08 01:08:43 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:43 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6d41e48-1e71-49ef-8e4a-21886664b92c tempest-GroupSnapshotsV319Test-388167599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bce0f674-aa0c-460e-af7f-6f23282888da -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.20e91439-e895-4b2f-8392-a54ad4d2ba7f" returned: 0 in 0.877s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:43 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-f6d41e48-1e71-49ef-8e4a-21886664b92c tempest-GroupSnapshotsV319Test-388167599 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.20e91439-e895-4b2f-8392-a54ad4d2ba7f is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:08:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6d41e48-1e71-49ef-8e4a-21886664b92c tempest-GroupSnapshotsV319Test-388167599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.20e91439-e895-4b2f-8392-a54ad4d2ba7f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:43 devstack sudo[96741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.20e91439-e895-4b2f-8392-a54ad4d2ba7f Jul 08 01:08:43 devstack sudo[96741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:43 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0520921d-9b13-4924-bd9d-42a3093e68ac tempest-TestServerVolumeAttachmentScenario-1331397985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1360cafc-40ba-417c-8b6e-84b9d45031e6" returned: 0 in 0.754s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0520921d-9b13-4924-bd9d-42a3093e68ac tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "cinder-quobyte-1360cafc-40ba-417c-8b6e-84b9d45031e6" released by "delete_volume" :: held 1.932s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:43 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c 1G" returned: 0 in 0.864s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:43 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba3cde3-26be-483c-9099-29ce366792ce]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:43 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-0520921d-9b13-4924-bd9d-42a3093e68ac tempest-TestServerVolumeAttachmentScenario-1331397985 None] Created reservations ['3b496bcb-ce6d-45d4-839a-e9bc6b8932e6', '1ce0ce7b-3835-4c46-b5e5-72ff9a740206', '4796488d-013a-4b5b-945b-172f11adf0b1', '4584057d-2c91-4f5b-b3b2-34b72cb21b43'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:08:44 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c Jul 08 01:08:44 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0520921d-9b13-4924-bd9d-42a3093e68ac tempest-TestServerVolumeAttachmentScenario-1331397985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0520921d-9b13-4924-bd9d-42a3093e68ac tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0520921d-9b13-4924-bd9d-42a3093e68ac tempest-TestServerVolumeAttachmentScenario-1331397985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0520921d-9b13-4924-bd9d-42a3093e68ac tempest-TestServerVolumeAttachmentScenario-1331397985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0520921d-9b13-4924-bd9d-42a3093e68ac tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0520921d-9b13-4924-bd9d-42a3093e68ac tempest-TestServerVolumeAttachmentScenario-1331397985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:44 devstack sudo[96741]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6d41e48-1e71-49ef-8e4a-21886664b92c tempest-GroupSnapshotsV319Test-388167599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.20e91439-e895-4b2f-8392-a54ad4d2ba7f" returned: 0 in 0.907s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:44 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:08:44 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6d41e48-1e71-49ef-8e4a-21886664b92c tempest-GroupSnapshotsV319Test-388167599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:44 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.info Jul 08 01:08:44 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:08:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:44 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:08:44 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:45 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c" returned: 0 in 1.125s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:45 devstack sudo[96779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c Jul 08 01:08:45 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:45 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e07e7a30-8e94-4972-85bf-06a248a5921f tempest-TestServerVolumeAttachmentScenario-1331397985 None] Acquiring lock "cinder-61173be8-a4bc-4fdc-a49e-4bba0c21cace-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:45 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0520921d-9b13-4924-bd9d-42a3093e68ac tempest-TestServerVolumeAttachmentScenario-1331397985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.199s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:45 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-0520921d-9b13-4924-bd9d-42a3093e68ac tempest-TestServerVolumeAttachmentScenario-1331397985 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:08:45 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e07e7a30-8e94-4972-85bf-06a248a5921f tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "cinder-61173be8-a4bc-4fdc-a49e-4bba0c21cace-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:45 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-0520921d-9b13-4924-bd9d-42a3093e68ac tempest-TestServerVolumeAttachmentScenario-1331397985 None] Deleted volume successfully. Jul 08 01:08:45 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0520921d-9b13-4924-bd9d-42a3093e68ac tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "cinder-1360cafc-40ba-417c-8b6e-84b9d45031e6-delete_volume" released by "delete_volume" :: held 3.736s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:45 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e07e7a30-8e94-4972-85bf-06a248a5921f tempest-TestServerVolumeAttachmentScenario-1331397985 None] Acquiring lock "cinder-quobyte-61173be8-a4bc-4fdc-a49e-4bba0c21cace" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:45 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e07e7a30-8e94-4972-85bf-06a248a5921f tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "cinder-quobyte-61173be8-a4bc-4fdc-a49e-4bba0c21cace" acquired by "delete_volume" :: waited 0.033s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:45 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ebfb3c-b07c-4c71-8c29-af3665a8932e]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e07e7a30-8e94-4972-85bf-06a248a5921f tempest-TestServerVolumeAttachmentScenario-1331397985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61173be8-a4bc-4fdc-a49e-4bba0c21cace {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:45 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6d41e48-1e71-49ef-8e4a-21886664b92c tempest-GroupSnapshotsV319Test-388167599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.info" returned: 0 in 1.388s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:45 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-f6d41e48-1e71-49ef-8e4a-21886664b92c tempest-GroupSnapshotsV319Test-388167599 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:08:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6d41e48-1e71-49ef-8e4a-21886664b92c tempest-GroupSnapshotsV319Test-388167599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:45 devstack sudo[96784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61173be8-a4bc-4fdc-a49e-4bba0c21cace Jul 08 01:08:45 devstack sudo[96784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:45 devstack sudo[96786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.info Jul 08 01:08:45 devstack sudo[96786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:46 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.337s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:46 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:08:46 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:08:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 28 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:08:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:08:46 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c" returned: 1 in 1.463s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:08:46 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Downloaded image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d ((None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}])) to volume 34fd45e3-effe-4b7b-9412-b395a5a0ab0c successfully. {{(pid=87123) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:08:46 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Temporary image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d for user c51d8843e21a49f0b9dfbc0c998af4f5 is deleted. {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:08:46 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Marking volume 34fd45e3-effe-4b7b-9412-b395a5a0ab0c as bootable. {{(pid=87123) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:08:46 devstack sudo[96784]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e07e7a30-8e94-4972-85bf-06a248a5921f tempest-TestServerVolumeAttachmentScenario-1331397985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61173be8-a4bc-4fdc-a49e-4bba0c21cace" returned: 0 in 0.919s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e07e7a30-8e94-4972-85bf-06a248a5921f tempest-TestServerVolumeAttachmentScenario-1331397985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61173be8-a4bc-4fdc-a49e-4bba0c21cace {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:46 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Copying metadata from image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d to 34fd45e3-effe-4b7b-9412-b395a5a0ab0c. {{(pid=87123) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:08:46 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Creating volume glance metadata for volume 34fd45e3-effe-4b7b-9412-b395a5a0ab0c backed by image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87123) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:08:46 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61173be8-a4bc-4fdc-a49e-4bba0c21cace Jul 08 01:08:46 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0bb4cef-5ac1-4d0e-9900-f002b7505d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c', 'volume_size': 1, 'image_id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '464063acafa44f9e90fd1bca62b64e8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'created_at': datetime.datetime(2026, 7, 7, 22, 51, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 51, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb85fe8-ef03-4937-a1c1-a3398705d6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:46 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Volume volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c (34fd45e3-effe-4b7b-9412-b395a5a0ab0c): created successfully Jul 08 01:08:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eb85fe8-ef03-4937-a1c1-a3398705d6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Flow 'volume_create_manager' (d9bf67ef-d525-4d86-b0a7-42ad68a64144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:46 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-11049717-a9f2-4905-97f7-e37faeb3e5ed tempest-VolumesImageMetadata-1717126085 None] Created volume successfully. Jul 08 01:08:46 devstack sudo[96786]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6d41e48-1e71-49ef-8e4a-21886664b92c tempest-GroupSnapshotsV319Test-388167599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.info" returned: 0 in 1.167s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f6d41e48-1e71-49ef-8e4a-21886664b92c tempest-GroupSnapshotsV319Test-388167599 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.622s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:47 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f6d41e48-1e71-49ef-8e4a-21886664b92c tempest-GroupSnapshotsV319Test-388167599 None] group_snapshot 88509e68-ea2f-4fad-9d56-d5220573a589: created successfully Jul 08 01:08:47 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e07e7a30-8e94-4972-85bf-06a248a5921f tempest-TestServerVolumeAttachmentScenario-1331397985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-61173be8-a4bc-4fdc-a49e-4bba0c21cace" returned: 0 in 0.873s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e07e7a30-8e94-4972-85bf-06a248a5921f tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "cinder-quobyte-61173be8-a4bc-4fdc-a49e-4bba0c21cace" released by "delete_volume" :: held 1.850s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:47 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-e07e7a30-8e94-4972-85bf-06a248a5921f tempest-TestServerVolumeAttachmentScenario-1331397985 None] Created reservations ['e8d4f2df-4300-4da9-b344-a4862c23fa7c', 'f3f69ffc-838c-4f61-86a8-627227e725d9', '3d0eb271-e922-4f87-bb53-26b42506def9', '655a0b7e-0cfa-42d9-8d0e-6bc37fe15d91'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:08:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e07e7a30-8e94-4972-85bf-06a248a5921f tempest-TestServerVolumeAttachmentScenario-1331397985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e07e7a30-8e94-4972-85bf-06a248a5921f tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e07e7a30-8e94-4972-85bf-06a248a5921f tempest-TestServerVolumeAttachmentScenario-1331397985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e07e7a30-8e94-4972-85bf-06a248a5921f tempest-TestServerVolumeAttachmentScenario-1331397985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e07e7a30-8e94-4972-85bf-06a248a5921f tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e07e7a30-8e94-4972-85bf-06a248a5921f tempest-TestServerVolumeAttachmentScenario-1331397985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] Acquiring lock "cinder-34fd45e3-effe-4b7b-9412-b395a5a0ab0c-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:47 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:08:47 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] Lock "cinder-34fd45e3-effe-4b7b-9412-b395a5a0ab0c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] Acquiring lock "cinder-quobyte-34fd45e3-effe-4b7b-9412-b395a5a0ab0c" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] Lock "cinder-quobyte-34fd45e3-effe-4b7b-9412-b395a5a0ab0c" acquired by "delete_volume" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:47 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ea691f-e333-44de-92ca-72ea894736e4]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:48 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c Jul 08 01:08:48 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:48 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] group_snapshot 88509e68-ea2f-4fad-9d56-d5220573a589: deleting Jul 08 01:08:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] group_snapshot 88509e68-ea2f-4fad-9d56-d5220573a589: deleting {{(pid=87123) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 08 01:08:48 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e07e7a30-8e94-4972-85bf-06a248a5921f tempest-TestServerVolumeAttachmentScenario-1331397985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.040s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:48 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-e07e7a30-8e94-4972-85bf-06a248a5921f tempest-TestServerVolumeAttachmentScenario-1331397985 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:08:48 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] Acquiring lock "cinder-quobyte-bce0f674-aa0c-460e-af7f-6f23282888da" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:48 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-e07e7a30-8e94-4972-85bf-06a248a5921f tempest-TestServerVolumeAttachmentScenario-1331397985 None] Deleted volume successfully. Jul 08 01:08:48 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] Lock "cinder-quobyte-bce0f674-aa0c-460e-af7f-6f23282888da" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:48 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] Acquiring lock "cinder-quobyte-20e91439-e895-4b2f-8392-a54ad4d2ba7f" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:48 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e07e7a30-8e94-4972-85bf-06a248a5921f tempest-TestServerVolumeAttachmentScenario-1331397985 None] Lock "cinder-61173be8-a4bc-4fdc-a49e-4bba0c21cace-delete_volume" released by "delete_volume" :: held 3.270s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:48 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] Lock "cinder-quobyte-20e91439-e895-4b2f-8392-a54ad4d2ba7f" acquired by "_delete_snapshot" :: waited 0.062s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] Deleting offline snapshot 20e91439-e895-4b2f-8392-a54ad4d2ba7f of volume bce0f674-aa0c-460e-af7f-6f23282888da {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:08:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] snapshot_file for this snap is: volume-bce0f674-aa0c-460e-af7f-6f23282888da.20e91439-e895-4b2f-8392-a54ad4d2ba7f {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:08:48 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9ca6f4-db79-4eed-9b2e-760ab45c8b9d]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.20e91439-e895-4b2f-8392-a54ad4d2ba7f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:49 devstack sudo[96807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.20e91439-e895-4b2f-8392-a54ad4d2ba7f Jul 08 01:08:49 devstack sudo[96807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:49 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c" returned: 0 in 1.477s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:49 devstack sudo[96811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c Jul 08 01:08:49 devstack sudo[96811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:49 devstack sudo[96807]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.20e91439-e895-4b2f-8392-a54ad4d2ba7f" returned: 0 in 1.029s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:49 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bce0f674-aa0c-460e-af7f-6f23282888da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:08:49 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c50f52-8179-4644-8c71-c78d74323855]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:50 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da Jul 08 01:08:50 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:50 devstack sudo[96811]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c" returned: 1 in 1.032s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:08:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:50 devstack sudo[96823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c Jul 08 01:08:50 devstack sudo[96823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:51 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da" returned: 0 in 1.063s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.20e91439-e895-4b2f-8392-a54ad4d2ba7f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:51 devstack sudo[96828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.20e91439-e895-4b2f-8392-a54ad4d2ba7f Jul 08 01:08:51 devstack sudo[96828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:51 devstack sudo[96823]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-34fd45e3-effe-4b7b-9412-b395a5a0ab0c" returned: 0 in 0.926s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:51 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] Lock "cinder-quobyte-34fd45e3-effe-4b7b-9412-b395a5a0ab0c" released by "delete_volume" :: held 3.554s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:51 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] Created reservations ['c38a4741-249b-44c0-8e9e-3465b40fa9b1', 'c5a8a11d-5299-4b21-b5a9-a0e985bef4d6', '89a91490-dd04-4922-9cf3-6bfbea37a391', '44e1788f-66fc-4172-bd03-0bf8ff8aa50e'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:08:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:51 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:08:51 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-99e4e606-40c4-457d-84d7-f2d4793fbec3 tempest-AttachVolumeTestJSON-1636764410 None] Acquiring lock "cinder-4de0be54-1cde-4921-9c15-4ec20ed03275-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-99e4e606-40c4-457d-84d7-f2d4793fbec3 tempest-AttachVolumeTestJSON-1636764410 None] Lock "cinder-4de0be54-1cde-4921-9c15-4ec20ed03275-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-99e4e606-40c4-457d-84d7-f2d4793fbec3 tempest-AttachVolumeTestJSON-1636764410 None] Acquiring lock "cinder-quobyte-4de0be54-1cde-4921-9c15-4ec20ed03275" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-99e4e606-40c4-457d-84d7-f2d4793fbec3 tempest-AttachVolumeTestJSON-1636764410 None] Lock "cinder-quobyte-4de0be54-1cde-4921-9c15-4ec20ed03275" acquired by "delete_volume" :: waited 0.062s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:52 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[663fc8e0-61ee-4918-8238-cd8306542723]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-99e4e606-40c4-457d-84d7-f2d4793fbec3 tempest-AttachVolumeTestJSON-1636764410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4de0be54-1cde-4921-9c15-4ec20ed03275 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:52 devstack sudo[96828]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.20e91439-e895-4b2f-8392-a54ad4d2ba7f" returned: 0 in 1.382s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.20e91439-e895-4b2f-8392-a54ad4d2ba7f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:52 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4de0be54-1cde-4921-9c15-4ec20ed03275 Jul 08 01:08:52 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:52 devstack sudo[96839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.20e91439-e895-4b2f-8392-a54ad4d2ba7f Jul 08 01:08:52 devstack sudo[96839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:52 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.260s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:52 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:08:52 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] Deleted volume successfully. Jul 08 01:08:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ca881161-f4c2-45fb-8211-04d4f1a82f57 tempest-VolumesImageMetadata-1717126085 None] Lock "cinder-34fd45e3-effe-4b7b-9412-b395a5a0ab0c-delete_volume" released by "delete_volume" :: held 5.153s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:53 devstack sudo[96839]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da.20e91439-e895-4b2f-8392-a54ad4d2ba7f" returned: 0 in 1.127s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] Lock "cinder-quobyte-20e91439-e895-4b2f-8392-a54ad4d2ba7f" released by "_delete_snapshot" :: held 4.778s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] Lock "cinder-quobyte-bce0f674-aa0c-460e-af7f-6f23282888da" released by "delete_snapshot" :: held 4.853s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:53 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-99e4e606-40c4-457d-84d7-f2d4793fbec3 tempest-AttachVolumeTestJSON-1636764410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4de0be54-1cde-4921-9c15-4ec20ed03275" returned: 0 in 1.444s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-99e4e606-40c4-457d-84d7-f2d4793fbec3 tempest-AttachVolumeTestJSON-1636764410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4de0be54-1cde-4921-9c15-4ec20ed03275 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:53 devstack sudo[96848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4de0be54-1cde-4921-9c15-4ec20ed03275 Jul 08 01:08:53 devstack sudo[96848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:53 devstack cinder-volume[87123]: WARNING cinder.quota [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-204610457 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-204610457, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:08:53 devstack cinder-volume[87123]: WARNING cinder.quota [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-204610457 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-204610457, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:08:53 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] Created reservations ['5b8bf753-cab2-4159-b405-4d9eda37a258', '09442657-faee-42ba-a48c-e236101445aa', 'eab65ee4-1c2c-4e37-a3dc-b302dd4696f4', '29383a11-172e-43ae-8448-4080fc1976b6'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:08:53 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-93a94911-58fc-4a13-a6d7-57a39f273542 tempest-GroupSnapshotsV319Test-388167599 None] group_snapshot 88509e68-ea2f-4fad-9d56-d5220573a589: deleted successfully Jul 08 01:08:54 devstack sudo[96848]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-99e4e606-40c4-457d-84d7-f2d4793fbec3 tempest-AttachVolumeTestJSON-1636764410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4de0be54-1cde-4921-9c15-4ec20ed03275" returned: 0 in 0.787s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-99e4e606-40c4-457d-84d7-f2d4793fbec3 tempest-AttachVolumeTestJSON-1636764410 None] Lock "cinder-quobyte-4de0be54-1cde-4921-9c15-4ec20ed03275" released by "delete_volume" :: held 2.301s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:54 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-99e4e606-40c4-457d-84d7-f2d4793fbec3 tempest-AttachVolumeTestJSON-1636764410 None] Created reservations ['941e2ce4-8028-4ade-a874-3b6d247e2be4', 'c5f0c493-a85a-425a-a25f-0ac70e99562b', '7991be4c-8004-4704-982f-759cf6dfce6d', '6d9fa542-9f21-4a68-9436-670919942335'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:08:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-99e4e606-40c4-457d-84d7-f2d4793fbec3 tempest-AttachVolumeTestJSON-1636764410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-99e4e606-40c4-457d-84d7-f2d4793fbec3 tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-99e4e606-40c4-457d-84d7-f2d4793fbec3 tempest-AttachVolumeTestJSON-1636764410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-99e4e606-40c4-457d-84d7-f2d4793fbec3 tempest-AttachVolumeTestJSON-1636764410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-99e4e606-40c4-457d-84d7-f2d4793fbec3 tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-99e4e606-40c4-457d-84d7-f2d4793fbec3 tempest-AttachVolumeTestJSON-1636764410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:54 devstack sudo[96851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:08:54 devstack sudo[96851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fbe72781-8a69-4713-aae6-91cba3452897 tempest-GroupSnapshotsV319Test-388167599 None] Acquiring lock "cinder-quobyte-bce0f674-aa0c-460e-af7f-6f23282888da" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fbe72781-8a69-4713-aae6-91cba3452897 tempest-GroupSnapshotsV319Test-388167599 None] Lock "cinder-quobyte-bce0f674-aa0c-460e-af7f-6f23282888da" acquired by "delete_volume" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:54 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[da87a82f-445f-440a-b3c2-5155f5cf41ff]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fbe72781-8a69-4713-aae6-91cba3452897 tempest-GroupSnapshotsV319Test-388167599 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:54 devstack sudo[96853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da Jul 08 01:08:54 devstack sudo[96853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:55 devstack sudo[96851]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-99e4e606-40c4-457d-84d7-f2d4793fbec3 tempest-AttachVolumeTestJSON-1636764410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.896s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:55 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-99e4e606-40c4-457d-84d7-f2d4793fbec3 tempest-AttachVolumeTestJSON-1636764410 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:08:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ee64a631-9985-4837-baf9-d579da44dced tempest-AttachVolumeTestJSON-1636764410 None] Acquiring lock "cinder-649b9eb9-408b-4d9a-b948-1d910fe3b293-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:55 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-99e4e606-40c4-457d-84d7-f2d4793fbec3 tempest-AttachVolumeTestJSON-1636764410 None] Deleted volume successfully. Jul 08 01:08:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ee64a631-9985-4837-baf9-d579da44dced tempest-AttachVolumeTestJSON-1636764410 None] Lock "cinder-649b9eb9-408b-4d9a-b948-1d910fe3b293-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-99e4e606-40c4-457d-84d7-f2d4793fbec3 tempest-AttachVolumeTestJSON-1636764410 None] Lock "cinder-4de0be54-1cde-4921-9c15-4ec20ed03275-delete_volume" released by "delete_volume" :: held 3.647s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ee64a631-9985-4837-baf9-d579da44dced tempest-AttachVolumeTestJSON-1636764410 None] Acquiring lock "cinder-quobyte-649b9eb9-408b-4d9a-b948-1d910fe3b293" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ee64a631-9985-4837-baf9-d579da44dced tempest-AttachVolumeTestJSON-1636764410 None] Lock "cinder-quobyte-649b9eb9-408b-4d9a-b948-1d910fe3b293" acquired by "delete_volume" :: waited 0.025s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:55 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[39460b4a-4097-4eeb-b826-cdef1fdc8fec]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ee64a631-9985-4837-baf9-d579da44dced tempest-AttachVolumeTestJSON-1636764410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-649b9eb9-408b-4d9a-b948-1d910fe3b293 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:55 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-649b9eb9-408b-4d9a-b948-1d910fe3b293 Jul 08 01:08:55 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:56 devstack sudo[96853]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fbe72781-8a69-4713-aae6-91cba3452897 tempest-GroupSnapshotsV319Test-388167599 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da" returned: 0 in 1.206s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fbe72781-8a69-4713-aae6-91cba3452897 tempest-GroupSnapshotsV319Test-388167599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:56 devstack sudo[96863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da Jul 08 01:08:56 devstack sudo[96863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Flow 'volume_create_manager' (bb76c892-ac48-4117-9a54-3b4a70e409f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad42cf09-95b2-4bae-b886-824b7a4f568a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:56 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ee64a631-9985-4837-baf9-d579da44dced tempest-AttachVolumeTestJSON-1636764410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-649b9eb9-408b-4d9a-b948-1d910fe3b293" returned: 0 in 1.081s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ee64a631-9985-4837-baf9-d579da44dced tempest-AttachVolumeTestJSON-1636764410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-649b9eb9-408b-4d9a-b948-1d910fe3b293 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad42cf09-95b2-4bae-b886-824b7a4f568a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1253072640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e2e4938-9e36-49ce-b66e-ed81aec24d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a754d8a407244bd18877f1da57fd410e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:57Z,use_quota=True,user_id='5b51ffa7fe0148858c07dc828b0c50bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae4be342-bf44-4e3c-b239-156876675177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:56 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-649b9eb9-408b-4d9a-b948-1d910fe3b293 Jul 08 01:08:56 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae4be342-bf44-4e3c-b239-156876675177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1280220c-183a-4a91-87c1-e228470cdc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1280220c-183a-4a91-87c1-e228470cdc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e2e4938-9e36-49ce-b66e-ed81aec24d83', 'volume_name': 'volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85aca0e-b32a-4f51-a8b1-fac4588ec52b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a85aca0e-b32a-4f51-a8b1-fac4588ec52b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27061b01-b0b7-4f3a-b6d0-ffb7f684f15c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:56 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Volume 6e2e4938-9e36-49ce-b66e-ed81aec24d83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83', 'volume_size': 1} Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:08:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1253072640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e2e4938-9e36-49ce-b66e-ed81aec24d83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a754d8a407244bd18877f1da57fd410e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:08:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:08:57Z,use_quota=True,user_id='5b51ffa7fe0148858c07dc828b0c50bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Creating volume 6e2e4938-9e36-49ce-b66e-ed81aec24d83 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:08:56 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:08:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:57 devstack sudo[96863]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fbe72781-8a69-4713-aae6-91cba3452897 tempest-GroupSnapshotsV319Test-388167599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bce0f674-aa0c-460e-af7f-6f23282888da" returned: 0 in 0.994s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:57 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 1073741824 Jul 08 01:08:57 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fbe72781-8a69-4713-aae6-91cba3452897 tempest-GroupSnapshotsV319Test-388167599 None] Lock "cinder-quobyte-bce0f674-aa0c-460e-af7f-6f23282888da" released by "delete_volume" :: held 2.300s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:57 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-fbe72781-8a69-4713-aae6-91cba3452897 tempest-GroupSnapshotsV319Test-388167599 None] Created reservations ['741a7376-dcc5-4996-be31-ca4a015831ca'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:08:57 devstack cinder-volume[87123]: WARNING cinder.quota [None req-fbe72781-8a69-4713-aae6-91cba3452897 tempest-GroupSnapshotsV319Test-388167599 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-204610457 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-204610457, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:08:57 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-fbe72781-8a69-4713-aae6-91cba3452897 tempest-GroupSnapshotsV319Test-388167599 None] Created reservations ['e04c7be9-0159-4894-8be9-95203b17fb9e', 'cfb5dbf0-1021-4a6a-a982-632e2f325999', 'cc4ff040-af91-4aab-8c2d-cfcd67045625', '0f859ea8-d20a-402a-971f-ad50ee09b1cc'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:08:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fbe72781-8a69-4713-aae6-91cba3452897 tempest-GroupSnapshotsV319Test-388167599 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fbe72781-8a69-4713-aae6-91cba3452897 tempest-GroupSnapshotsV319Test-388167599 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:57 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-fbe72781-8a69-4713-aae6-91cba3452897 tempest-GroupSnapshotsV319Test-388167599 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:57 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-fbe72781-8a69-4713-aae6-91cba3452897 tempest-GroupSnapshotsV319Test-388167599 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fbe72781-8a69-4713-aae6-91cba3452897 tempest-GroupSnapshotsV319Test-388167599 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fbe72781-8a69-4713-aae6-91cba3452897 tempest-GroupSnapshotsV319Test-388167599 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:57 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:08:57 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:58 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ee64a631-9985-4837-baf9-d579da44dced tempest-AttachVolumeTestJSON-1636764410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-649b9eb9-408b-4d9a-b948-1d910fe3b293" returned: 0 in 1.276s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ee64a631-9985-4837-baf9-d579da44dced tempest-AttachVolumeTestJSON-1636764410 None] Lock "cinder-quobyte-649b9eb9-408b-4d9a-b948-1d910fe3b293" released by "delete_volume" :: held 2.419s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:58 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 1073741824" returned: 0 in 1.258s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:58 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-ee64a631-9985-4837-baf9-d579da44dced tempest-AttachVolumeTestJSON-1636764410 None] Created reservations ['23198ab4-08eb-48e1-9a56-1ad8901e31ec', '95f85f4e-18ae-43e0-96f4-befe967b1a5b', '116f30ed-92aa-4fba-b161-d70d0d3e3f79', 'a50b7870-2f21-454a-adfc-539c2a3c0b6f'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:08:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:58 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 Jul 08 01:08:58 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ee64a631-9985-4837-baf9-d579da44dced tempest-AttachVolumeTestJSON-1636764410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:08:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ee64a631-9985-4837-baf9-d579da44dced tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:08:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ee64a631-9985-4837-baf9-d579da44dced tempest-AttachVolumeTestJSON-1636764410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:08:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ee64a631-9985-4837-baf9-d579da44dced tempest-AttachVolumeTestJSON-1636764410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:08:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ee64a631-9985-4837-baf9-d579da44dced tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ee64a631-9985-4837-baf9-d579da44dced tempest-AttachVolumeTestJSON-1636764410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:58 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fbe72781-8a69-4713-aae6-91cba3452897 tempest-GroupSnapshotsV319Test-388167599 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.818s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:58 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-fbe72781-8a69-4713-aae6-91cba3452897 tempest-GroupSnapshotsV319Test-388167599 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:08:58 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-fbe72781-8a69-4713-aae6-91cba3452897 tempest-GroupSnapshotsV319Test-388167599 None] Delete group completed successfully. Jul 08 01:08:58 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:08:58 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:08:59 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ee64a631-9985-4837-baf9-d579da44dced tempest-AttachVolumeTestJSON-1636764410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.913s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:59 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-ee64a631-9985-4837-baf9-d579da44dced tempest-AttachVolumeTestJSON-1636764410 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:08:59 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Jul 08 01:08:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83" returned: 0 in 1.036s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:08:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] <== create_volume: return (2370ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:08:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.375s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:08:59 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-ee64a631-9985-4837-baf9-d579da44dced tempest-AttachVolumeTestJSON-1636764410 None] Deleted volume successfully. Jul 08 01:08:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27061b01-b0b7-4f3a-b6d0-ffb7f684f15c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6cabef6-0110-48d3-8941-a6a53a6ab6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:08:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-010f8773-ba64-4028-b6be-0610c971ac12 tempest-AttachVolumeTestJSON-1636764410 None] Acquiring lock "cinder-5faae36d-d2ef-45ce-9276-e51d68821896-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:59 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Volume volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 (6e2e4938-9e36-49ce-b66e-ed81aec24d83): created successfully Jul 08 01:08:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6cabef6-0110-48d3-8941-a6a53a6ab6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:08:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Flow 'volume_create_manager' (bb76c892-ac48-4117-9a54-3b4a70e409f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:08:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ee64a631-9985-4837-baf9-d579da44dced tempest-AttachVolumeTestJSON-1636764410 None] Lock "cinder-649b9eb9-408b-4d9a-b948-1d910fe3b293-delete_volume" released by "delete_volume" :: held 3.738s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:08:59 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-4467ead2-12e4-47a4-a9d6-f52807172946 tempest-VolumesDeleteCascade-164193008 None] Created volume successfully. Jul 08 01:08:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-010f8773-ba64-4028-b6be-0610c971ac12 tempest-AttachVolumeTestJSON-1636764410 None] Lock "cinder-5faae36d-d2ef-45ce-9276-e51d68821896-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-010f8773-ba64-4028-b6be-0610c971ac12 tempest-AttachVolumeTestJSON-1636764410 None] Acquiring lock "cinder-quobyte-5faae36d-d2ef-45ce-9276-e51d68821896" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:08:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-010f8773-ba64-4028-b6be-0610c971ac12 tempest-AttachVolumeTestJSON-1636764410 None] Lock "cinder-quobyte-5faae36d-d2ef-45ce-9276-e51d68821896" acquired by "delete_volume" :: waited 0.025s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:08:59 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c69133-ac0a-49c6-9376-a03d307822cf]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:08:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-010f8773-ba64-4028-b6be-0610c971ac12 tempest-AttachVolumeTestJSON-1636764410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5faae36d-d2ef-45ce-9276-e51d68821896 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:08:59 devstack sudo[96888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5faae36d-d2ef-45ce-9276-e51d68821896 Jul 08 01:08:59 devstack sudo[96888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2c0f80e3-aefd-4006-b5d4-321cb60bf314 tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2c0f80e3-aefd-4006-b5d4-321cb60bf314 tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-2c0f80e3-aefd-4006-b5d4-321cb60bf314 tempest-VolumesDeleteCascade-164193008 None] Creating offline snapshot 0a063f3e-36c0-42ee-b365-514f2d15b47e of volume 6e2e4938-9e36-49ce-b66e-ed81aec24d83 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:09:00 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5f00ee8-bc7a-4922-be05-74fa66ba9f55]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2c0f80e3-aefd-4006-b5d4-321cb60bf314 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:00 devstack sudo[96888]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-010f8773-ba64-4028-b6be-0610c971ac12 tempest-AttachVolumeTestJSON-1636764410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5faae36d-d2ef-45ce-9276-e51d68821896" returned: 0 in 1.043s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-010f8773-ba64-4028-b6be-0610c971ac12 tempest-AttachVolumeTestJSON-1636764410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5faae36d-d2ef-45ce-9276-e51d68821896 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:00 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5faae36d-d2ef-45ce-9276-e51d68821896 Jul 08 01:09:00 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:00 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 Jul 08 01:09:00 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:01 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-010f8773-ba64-4028-b6be-0610c971ac12 tempest-AttachVolumeTestJSON-1636764410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5faae36d-d2ef-45ce-9276-e51d68821896" returned: 0 in 0.914s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:01 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-010f8773-ba64-4028-b6be-0610c971ac12 tempest-AttachVolumeTestJSON-1636764410 None] Lock "cinder-quobyte-5faae36d-d2ef-45ce-9276-e51d68821896" released by "delete_volume" :: held 2.035s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:01 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-010f8773-ba64-4028-b6be-0610c971ac12 tempest-AttachVolumeTestJSON-1636764410 None] Created reservations ['02f0b9a1-9c3f-43e9-a770-5d2790e55d19', '8e87a892-87c0-4cb2-8eaa-4fc21f1bc33e', '14b04d59-9cd3-4bad-b303-49abf68684c1', '832e6c2b-56d4-4886-a26e-0cebc6406bf5'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:09:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-010f8773-ba64-4028-b6be-0610c971ac12 tempest-AttachVolumeTestJSON-1636764410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-010f8773-ba64-4028-b6be-0610c971ac12 tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-010f8773-ba64-4028-b6be-0610c971ac12 tempest-AttachVolumeTestJSON-1636764410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:01 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-010f8773-ba64-4028-b6be-0610c971ac12 tempest-AttachVolumeTestJSON-1636764410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-010f8773-ba64-4028-b6be-0610c971ac12 tempest-AttachVolumeTestJSON-1636764410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-010f8773-ba64-4028-b6be-0610c971ac12 tempest-AttachVolumeTestJSON-1636764410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2c0f80e3-aefd-4006-b5d4-321cb60bf314 tempest-VolumesDeleteCascade-164193008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83" returned: 0 in 1.298s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2c0f80e3-aefd-4006-b5d4-321cb60bf314 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:01 devstack sudo[96904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:09:01 devstack sudo[96904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:01 devstack sudo[96905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e 1G Jul 08 01:09:01 devstack sudo[96905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:02 devstack sudo[96904]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-010f8773-ba64-4028-b6be-0610c971ac12 tempest-AttachVolumeTestJSON-1636764410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.099s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:02 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-010f8773-ba64-4028-b6be-0610c971ac12 tempest-AttachVolumeTestJSON-1636764410 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:09:02 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-010f8773-ba64-4028-b6be-0610c971ac12 tempest-AttachVolumeTestJSON-1636764410 None] Deleted volume successfully. Jul 08 01:09:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-010f8773-ba64-4028-b6be-0610c971ac12 tempest-AttachVolumeTestJSON-1636764410 None] Lock "cinder-5faae36d-d2ef-45ce-9276-e51d68821896-delete_volume" released by "delete_volume" :: held 3.567s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:03 devstack sudo[96905]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2c0f80e3-aefd-4006-b5d4-321cb60bf314 tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e 1G" returned: 0 in 1.334s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2c0f80e3-aefd-4006-b5d4-321cb60bf314 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:03 devstack sudo[96912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e Jul 08 01:09:03 devstack sudo[96912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:04 devstack sudo[96912]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2c0f80e3-aefd-4006-b5d4-321cb60bf314 tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e" returned: 0 in 1.046s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:04 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-2c0f80e3-aefd-4006-b5d4-321cb60bf314 tempest-VolumesDeleteCascade-164193008 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e is being set with open permissions: ugo+rw Jul 08 01:09:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2c0f80e3-aefd-4006-b5d4-321cb60bf314 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:04 devstack sudo[96918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e Jul 08 01:09:04 devstack sudo[96918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:05 devstack sudo[96918]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2c0f80e3-aefd-4006-b5d4-321cb60bf314 tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e" returned: 0 in 0.836s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2c0f80e3-aefd-4006-b5d4-321cb60bf314 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:05 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.info Jul 08 01:09:05 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:05 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2c0f80e3-aefd-4006-b5d4-321cb60bf314 tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.info" returned: 0 in 0.773s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:05 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-2c0f80e3-aefd-4006-b5d4-321cb60bf314 tempest-VolumesDeleteCascade-164193008 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.info is being set with open permissions: ugo+rw Jul 08 01:09:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2c0f80e3-aefd-4006-b5d4-321cb60bf314 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:05 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.info Jul 08 01:09:05 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:06 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2c0f80e3-aefd-4006-b5d4-321cb60bf314 tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.info" returned: 0 in 0.864s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2c0f80e3-aefd-4006-b5d4-321cb60bf314 tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.382s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:06 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-2c0f80e3-aefd-4006-b5d4-321cb60bf314 tempest-VolumesDeleteCascade-164193008 None] Create snapshot completed successfully Jul 08 01:09:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-940d4c46-2200-4b95-b075-e0255056ae14 tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-940d4c46-2200-4b95-b075-e0255056ae14 tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:08 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-940d4c46-2200-4b95-b075-e0255056ae14 tempest-VolumesDeleteCascade-164193008 None] Creating offline snapshot a6483026-1927-4242-9d15-f053abf58596 of volume 6e2e4938-9e36-49ce-b66e-ed81aec24d83 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:09:08 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f342b3-7bdf-4664-b6de-70e5bc1c2692]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-940d4c46-2200-4b95-b075-e0255056ae14 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:08 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e Jul 08 01:09:08 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:09 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-940d4c46-2200-4b95-b075-e0255056ae14 tempest-VolumesDeleteCascade-164193008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e" returned: 0 in 1.101s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-940d4c46-2200-4b95-b075-e0255056ae14 tempest-VolumesDeleteCascade-164193008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:09:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-940d4c46-2200-4b95-b075-e0255056ae14 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:09 devstack sudo[96934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596 1G Jul 08 01:09:09 devstack sudo[96934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:10 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:09:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Flow 'volume_create_manager' (ef6f05a0-0959-4480-8e82-5401517d3275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac20032-ec6b-44ba-a669-f5ea16044236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac20032-ec6b-44ba-a669-f5ea16044236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6cadb94-2e9c-4701-8b51-705eb64ee13f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cafacdecb5942718bb64ff897b944e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:10Z,use_quota=True,user_id='41e8aaf2d63f4ad5b6c4b8f9488662ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa03ec19-8c01-4f54-a02e-f7479354bbaa),volume_type_id=fa03ec19-8c01-4f54-a02e-f7479354bbaa)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542f1fda-5f98-448a-ab22-762871da269f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (542f1fda-5f98-448a-ab22-762871da269f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53375761-5ad2-4d16-a90b-f965deff038e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:10 devstack cinder-volume[87123]: DEBUG cinder.image.glance [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Creating Keystone auth plugin from conf {{(pid=87123) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:09:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53375761-5ad2-4d16-a90b-f965deff038e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd6cadb94-2e9c-4701-8b51-705eb64ee13f', 'volume_name': 'volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f', 'volume_size': 1, 'image_id': '4feb86a4-1801-4445-84b1-35c75aad91a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4feb86a4-1801-4445-84b1-35c75aad91a4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'df1eccb73db12839e303ff9b14a71514', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5cafacdecb5942718bb64ff897b944e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '20fc6363a672fdba74777decf89f924d1b35978d96dec75121d2694c562b03ada3501a5801ec51a1272cdc6814c21d004d5e7eebb9a8bec915102101a8394a5b', 'id': '4feb86a4-1801-4445-84b1-35c75aad91a4', 'created_at': datetime.datetime(2026, 7, 7, 23, 9, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 9, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4feb86a4-1801-4445-84b1-35c75aad91a4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3067865f-a985-4d21-b0d2-15d1540c8846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3067865f-a985-4d21-b0d2-15d1540c8846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:10 devstack sudo[96934]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101ebb0a-5c5a-4464-a03c-0085bb4a804b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:10 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Volume d6cadb94-2e9c-4701-8b51-705eb64ee13f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f', 'volume_size': 1, 'image_id': '4feb86a4-1801-4445-84b1-35c75aad91a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4feb86a4-1801-4445-84b1-35c75aad91a4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'df1eccb73db12839e303ff9b14a71514', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5cafacdecb5942718bb64ff897b944e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '20fc6363a672fdba74777decf89f924d1b35978d96dec75121d2694c562b03ada3501a5801ec51a1272cdc6814c21d004d5e7eebb9a8bec915102101a8394a5b', 'id': '4feb86a4-1801-4445-84b1-35c75aad91a4', 'created_at': datetime.datetime(2026, 7, 7, 23, 9, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 9, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4feb86a4-1801-4445-84b1-35c75aad91a4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 01:09:10 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Trying to clone d6cadb94-2e9c-4701-8b51-705eb64ee13f from image 4feb86a4-1801-4445-84b1-35c75aad91a4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4feb86a4-1801-4445-84b1-35c75aad91a4', 'metadata': {}}]). {{(pid=87123) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:09:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-940d4c46-2200-4b95-b075-e0255056ae14 tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596 1G" returned: 0 in 1.272s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-940d4c46-2200-4b95-b075-e0255056ae14 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:10 devstack sudo[96941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596 Jul 08 01:09:10 devstack sudo[96941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:10 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:09:10 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Image download 0.00 MB at 0.00 MB/s Jul 08 01:09:11 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d5b8e8-8128-4aaa-999d-1e68ffeb3e26]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:11 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD Jul 08 01:09:11 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:11 devstack sudo[96941]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-940d4c46-2200-4b95-b075-e0255056ae14 tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596" returned: 0 in 1.115s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:11 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-940d4c46-2200-4b95-b075-e0255056ae14 tempest-VolumesDeleteCascade-164193008 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596 is being set with open permissions: ugo+rw Jul 08 01:09:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-940d4c46-2200-4b95-b075-e0255056ae14 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:12 devstack sudo[96984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596 Jul 08 01:09:12 devstack sudo[96984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:12 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD" returned: 0 in 1.274s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:12 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD Jul 08 01:09:12 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:12 devstack sudo[96984]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-940d4c46-2200-4b95-b075-e0255056ae14 tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596" returned: 0 in 0.926s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-940d4c46-2200-4b95-b075-e0255056ae14 tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.603s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:13 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-940d4c46-2200-4b95-b075-e0255056ae14 tempest-VolumesDeleteCascade-164193008 None] Create snapshot completed successfully Jul 08 01:09:13 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD" returned: 1 in 0.985s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Temporary image 4feb86a4-1801-4445-84b1-35c75aad91a4 is fetched for user 41e8aaf2d63f4ad5b6c4b8f9488662ea. {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3fd5f5-6e4c-46cd-b7f8-29dff5321074]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:13 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD Jul 08 01:09:13 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "cinder-6e2e4938-9e36-49ce-b66e-ed81aec24d83-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Flow 'volume_create_manager' (9c355509-eb38-4d75-9245-a7153813526c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8d06ea-997c-49e6-92cd-9da8310bd849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8d06ea-997c-49e6-92cd-9da8310bd849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-163749903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f6989a5-17fa-4c97-9028-7811ad52e3d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1693d7c99d124b09aced9bb1daa65625',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:14Z,use_quota=True,user_id='5eea5254af1447069c0a5230c6125db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f836d013-da5b-4c6a-b2df-2fa51b92a1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f836d013-da5b-4c6a-b2df-2fa51b92a1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a2dab0c-d2dd-4097-b96c-e00633e03683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a2dab0c-d2dd-4097-b96c-e00633e03683) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f6989a5-17fa-4c97-9028-7811ad52e3d9', 'volume_name': 'volume-7f6989a5-17fa-4c97-9028-7811ad52e3d9', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03b51c7-14c7-428e-97b9-ee277dbbaf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03b51c7-14c7-428e-97b9-ee277dbbaf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebcdd53d-ac28-46c0-af95-ac67c6c6f7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:13 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Volume 7f6989a5-17fa-4c97-9028-7811ad52e3d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f6989a5-17fa-4c97-9028-7811ad52e3d9', 'volume_size': 1} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-163749903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f6989a5-17fa-4c97-9028-7811ad52e3d9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='1693d7c99d124b09aced9bb1daa65625',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:14Z,use_quota=True,user_id='5eea5254af1447069c0a5230c6125db2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Creating volume 7f6989a5-17fa-4c97-9028-7811ad52e3d9 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:09:13 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7f6989a5-17fa-4c97-9028-7811ad52e3d9 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-6e2e4938-9e36-49ce-b66e-ed81aec24d83-delete_volume" acquired by "delete_volume" :: waited 0.152s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:13 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7f6989a5-17fa-4c97-9028-7811ad52e3d9 1073741824 Jul 08 01:09:13 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Performing cascade delete. {{(pid=87123) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "cinder-0a063f3e-36c0-42ee-b365-514f2d15b47e-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-0a063f3e-36c0-42ee-b365-514f2d15b47e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "cinder-quobyte-6e2e4938-9e36-49ce-b66e-ed81aec24d83" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-quobyte-6e2e4938-9e36-49ce-b66e-ed81aec24d83" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "cinder-quobyte-0a063f3e-36c0-42ee-b365-514f2d15b47e" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-quobyte-0a063f3e-36c0-42ee-b365-514f2d15b47e" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:14 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Deleting offline snapshot 0a063f3e-36c0-42ee-b365-514f2d15b47e of volume 6e2e4938-9e36-49ce-b66e-ed81aec24d83 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:09:14 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] snapshot_file for this snap is: volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:09:14 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb16c36-dd3d-4f4f-83e4-433826bcfa0b]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:14 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e Jul 08 01:09:14 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:14 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD" returned: 0 in 0.937s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:14 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD Jul 08 01:09:14 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:14 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7f6989a5-17fa-4c97-9028-7811ad52e3d9 1073741824" returned: 0 in 1.088s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7f6989a5-17fa-4c97-9028-7811ad52e3d9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:15 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7f6989a5-17fa-4c97-9028-7811ad52e3d9 Jul 08 01:09:15 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:15 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e" returned: 0 in 1.114s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:09:15 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[db6abf9c-37c0-4684-b800-4612c3b5a1f8]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:15 devstack sudo[97016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 Jul 08 01:09:15 devstack sudo[97016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:15 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD" returned: 1 in 1.053s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:09:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:15 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7f6989a5-17fa-4c97-9028-7811ad52e3d9" returned: 0 in 0.899s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] <== create_volume: return (2061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:09:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.065s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.482s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6cadb94-2e9c-4701-8b51-705eb64ee13f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cafacdecb5942718bb64ff897b944e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:10Z,use_quota=True,user_id='41e8aaf2d63f4ad5b6c4b8f9488662ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fa03ec19-8c01-4f54-a02e-f7479354bbaa),volume_type_id=fa03ec19-8c01-4f54-a02e-f7479354bbaa)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:09:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Creating volume d6cadb94-2e9c-4701-8b51-705eb64ee13f {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:09:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:09:15 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:09:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebcdd53d-ac28-46c0-af95-ac67c6c6f7b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f6989a5-17fa-4c97-9028-7811ad52e3d9', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:15 devstack sudo[97022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f 1073741824 Jul 08 01:09:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f00b9db0-0d4d-4ec8-b982-06d0d85e5875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:16 devstack sudo[97022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:16 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Volume volume-7f6989a5-17fa-4c97-9028-7811ad52e3d9 (7f6989a5-17fa-4c97-9028-7811ad52e3d9): created successfully Jul 08 01:09:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f00b9db0-0d4d-4ec8-b982-06d0d85e5875) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Flow 'volume_create_manager' (9c355509-eb38-4d75-9245-a7153813526c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:16 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-0f77b271-1e41-4f8b-abd4-d4b56f438184 req-b008ce3c-d0c2-4d16-84df-7a7862492090 tempest-VolumesGetTestJSON-879367057 None] Created volume successfully. Jul 08 01:09:16 devstack sudo[97016]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83" returned: 0 in 0.963s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:16 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[553d3443-4e84-43f6-9df7-6ee58a035cd3]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:16 devstack sudo[97028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596 Jul 08 01:09:16 devstack sudo[97028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:17 devstack sudo[97022]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f 1073741824" returned: 0 in 1.095s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:17 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f Jul 08 01:09:17 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:17 devstack sudo[97028]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596" returned: 0 in 1.011s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:09:17 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6700739-b8de-4119-b7fe-9b337955f107]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:17 devstack sudo[97038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e Jul 08 01:09:17 devstack sudo[97038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-37938904-a905-47d2-98cc-d56d931e1d7e req-381342db-60e3-4f92-8c49-b5a1845e003b tempest-VolumesGetTestJSON-879367057 None] Acquiring lock "cinder-7f6989a5-17fa-4c97-9028-7811ad52e3d9-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-37938904-a905-47d2-98cc-d56d931e1d7e req-381342db-60e3-4f92-8c49-b5a1845e003b tempest-VolumesGetTestJSON-879367057 None] Lock "cinder-7f6989a5-17fa-4c97-9028-7811ad52e3d9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-37938904-a905-47d2-98cc-d56d931e1d7e req-381342db-60e3-4f92-8c49-b5a1845e003b tempest-VolumesGetTestJSON-879367057 None] Acquiring lock "cinder-quobyte-7f6989a5-17fa-4c97-9028-7811ad52e3d9" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-37938904-a905-47d2-98cc-d56d931e1d7e req-381342db-60e3-4f92-8c49-b5a1845e003b tempest-VolumesGetTestJSON-879367057 None] Lock "cinder-quobyte-7f6989a5-17fa-4c97-9028-7811ad52e3d9" acquired by "delete_volume" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:17 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[f496d465-ad7c-479c-acf0-e597ff330ad7]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-37938904-a905-47d2-98cc-d56d931e1d7e req-381342db-60e3-4f92-8c49-b5a1845e003b tempest-VolumesGetTestJSON-879367057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7f6989a5-17fa-4c97-9028-7811ad52e3d9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:17 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7f6989a5-17fa-4c97-9028-7811ad52e3d9 Jul 08 01:09:17 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:17 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f" returned: 0 in 0.812s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] <== create_volume: return (1981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:09:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.987s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:17 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Attempting download of 4feb86a4-1801-4445-84b1-35c75aad91a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/4feb86a4-1801-4445-84b1-35c75aad91a4', 'metadata': {}}])) to volume d6cadb94-2e9c-4701-8b51-705eb64ee13f. {{(pid=87123) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[54746dea-5a91-461a-ae9b-e31725c9d425]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4feb86a4-1801-4445-84b1-35c75aad91a4__nsbnjrt {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:18 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4feb86a4-1801-4445-84b1-35c75aad91a4__nsbnjrt Jul 08 01:09:18 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Flow 'volume_create_manager' (4b2c0d4e-a277-48f1-abc6-fce8931eb962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926b0e5c-aa9f-4b21-b7a0-189aca1d86e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:18 devstack sudo[97038]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (926b0e5c-aa9f-4b21-b7a0-189aca1d86e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-151860122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846be456-b9ae-4e8c-bdb3-67675710c9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45777aed7f8a4e1b81786e084dbdc8a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:18Z,use_quota=True,user_id='2c872665df8d43f9b74b248bacee234b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae35279d-822f-43db-bad6-2e1287792aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae35279d-822f-43db-bad6-2e1287792aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66989b6f-25d4-4705-a269-686d215f9b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66989b6f-25d4-4705-a269-686d215f9b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '846be456-b9ae-4e8c-bdb3-67675710c9cb', 'volume_name': 'volume-846be456-b9ae-4e8c-bdb3-67675710c9cb', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985c84d2-d934-438a-b87f-8b286286cc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (985c84d2-d934-438a-b87f-8b286286cc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314e0e8f-5504-462c-a63b-bd739989d227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:18 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Volume 846be456-b9ae-4e8c-bdb3-67675710c9cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-846be456-b9ae-4e8c-bdb3-67675710c9cb', 'volume_size': 1} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-151860122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846be456-b9ae-4e8c-bdb3-67675710c9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45777aed7f8a4e1b81786e084dbdc8a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:18Z,use_quota=True,user_id='2c872665df8d43f9b74b248bacee234b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Creating volume 846be456-b9ae-4e8c-bdb3-67675710c9cb {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:09:18 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-846be456-b9ae-4e8c-bdb3-67675710c9cb 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e" returned: 0 in 1.339s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:09:18 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-846be456-b9ae-4e8c-bdb3-67675710c9cb 1073741824 Jul 08 01:09:18 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[2982051b-13db-4c14-9200-af389cdb360f]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:18 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-37938904-a905-47d2-98cc-d56d931e1d7e req-381342db-60e3-4f92-8c49-b5a1845e003b tempest-VolumesGetTestJSON-879367057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7f6989a5-17fa-4c97-9028-7811ad52e3d9" returned: 0 in 0.998s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-37938904-a905-47d2-98cc-d56d931e1d7e req-381342db-60e3-4f92-8c49-b5a1845e003b tempest-VolumesGetTestJSON-879367057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7f6989a5-17fa-4c97-9028-7811ad52e3d9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:18 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7f6989a5-17fa-4c97-9028-7811ad52e3d9 Jul 08 01:09:18 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:18 devstack sudo[97056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 Jul 08 01:09:18 devstack sudo[97056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:18 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4feb86a4-1801-4445-84b1-35c75aad91a4__nsbnjrt" returned: 0 in 0.916s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4feb86a4-1801-4445-84b1-35c75aad91a4__nsbnjrt {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:19 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4feb86a4-1801-4445-84b1-35c75aad91a4__nsbnjrt Jul 08 01:09:19 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:19 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-37938904-a905-47d2-98cc-d56d931e1d7e req-381342db-60e3-4f92-8c49-b5a1845e003b tempest-VolumesGetTestJSON-879367057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7f6989a5-17fa-4c97-9028-7811ad52e3d9" returned: 0 in 0.820s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:19 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-37938904-a905-47d2-98cc-d56d931e1d7e req-381342db-60e3-4f92-8c49-b5a1845e003b tempest-VolumesGetTestJSON-879367057 None] Lock "cinder-quobyte-7f6989a5-17fa-4c97-9028-7811ad52e3d9" released by "delete_volume" :: held 1.907s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:19 devstack cinder-volume[87123]: DEBUG cinder.quota [req-37938904-a905-47d2-98cc-d56d931e1d7e req-381342db-60e3-4f92-8c49-b5a1845e003b tempest-VolumesGetTestJSON-879367057 None] Created reservations ['faa963bf-84ef-4699-bee5-b0c759e92960', 'bd82e6db-441c-4561-844b-2972055a8aa1', '5194f1e4-f859-46a3-9b23-eb4be1b9ce0a', 'ae903132-e10f-4cf5-b347-70c46043d02a'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:09:19 devstack sudo[97056]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83" returned: 0 in 0.996s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:19 devstack sudo[97074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e Jul 08 01:09:19 devstack sudo[97074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-37938904-a905-47d2-98cc-d56d931e1d7e req-381342db-60e3-4f92-8c49-b5a1845e003b tempest-VolumesGetTestJSON-879367057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-37938904-a905-47d2-98cc-d56d931e1d7e req-381342db-60e3-4f92-8c49-b5a1845e003b tempest-VolumesGetTestJSON-879367057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [req-37938904-a905-47d2-98cc-d56d931e1d7e req-381342db-60e3-4f92-8c49-b5a1845e003b tempest-VolumesGetTestJSON-879367057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [req-37938904-a905-47d2-98cc-d56d931e1d7e req-381342db-60e3-4f92-8c49-b5a1845e003b tempest-VolumesGetTestJSON-879367057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-37938904-a905-47d2-98cc-d56d931e1d7e req-381342db-60e3-4f92-8c49-b5a1845e003b tempest-VolumesGetTestJSON-879367057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-37938904-a905-47d2-98cc-d56d931e1d7e req-381342db-60e3-4f92-8c49-b5a1845e003b tempest-VolumesGetTestJSON-879367057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:19 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:09:19 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:19 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-846be456-b9ae-4e8c-bdb3-67675710c9cb 1073741824" returned: 0 in 1.196s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-846be456-b9ae-4e8c-bdb3-67675710c9cb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:19 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-846be456-b9ae-4e8c-bdb3-67675710c9cb Jul 08 01:09:19 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:20 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4feb86a4-1801-4445-84b1-35c75aad91a4__nsbnjrt" returned: 1 in 1.408s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4feb86a4-1801-4445-84b1-35c75aad91a4__nsbnjrt' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:09:20 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[35944009-8ab8-4e7d-aa79-ae0c79293fec]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:20 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD Jul 08 01:09:20 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:20 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-37938904-a905-47d2-98cc-d56d931e1d7e req-381342db-60e3-4f92-8c49-b5a1845e003b tempest-VolumesGetTestJSON-879367057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.069s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:20 devstack cinder-volume[87123]: DEBUG cinder.manager [req-37938904-a905-47d2-98cc-d56d931e1d7e req-381342db-60e3-4f92-8c49-b5a1845e003b tempest-VolumesGetTestJSON-879367057 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:09:20 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-37938904-a905-47d2-98cc-d56d931e1d7e req-381342db-60e3-4f92-8c49-b5a1845e003b tempest-VolumesGetTestJSON-879367057 None] Deleted volume successfully. Jul 08 01:09:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-37938904-a905-47d2-98cc-d56d931e1d7e req-381342db-60e3-4f92-8c49-b5a1845e003b tempest-VolumesGetTestJSON-879367057 None] Lock "cinder-7f6989a5-17fa-4c97-9028-7811ad52e3d9-delete_volume" released by "delete_volume" :: held 3.319s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:20 devstack sudo[97074]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e" returned: 0 in 1.276s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:20 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e Jul 08 01:09:20 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:21 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-846be456-b9ae-4e8c-bdb3-67675710c9cb" returned: 0 in 1.270s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] <== create_volume: return (2519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:09:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.522s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (314e0e8f-5504-462c-a63b-bd739989d227) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-846be456-b9ae-4e8c-bdb3-67675710c9cb', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb2a9a10-8894-42d0-bbdb-6210cc1fb414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:21 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Volume volume-846be456-b9ae-4e8c-bdb3-67675710c9cb (846be456-b9ae-4e8c-bdb3-67675710c9cb): created successfully Jul 08 01:09:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb2a9a10-8894-42d0-bbdb-6210cc1fb414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Flow 'volume_create_manager' (4b2c0d4e-a277-48f1-abc6-fce8931eb962) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:21 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-2ff82684-2a01-4816-ad75-c4bbb6eca7ad tempest-VolumeQuotasAdminTestJSON-1362601535 None] Created volume successfully. Jul 08 01:09:21 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD" returned: 0 in 1.133s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:21 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD Jul 08 01:09:21 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:21 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.0a063f3e-36c0-42ee-b365-514f2d15b47e" returned: 0 in 0.794s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596 -F qcow2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:21 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596 -F qcow2 Jul 08 01:09:21 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-7e4a61a2-974e-49b8-b1d9-0c515482ffbc tempest-VolumeQuotasAdminTestJSON-1362601535 None] Acquiring lock "cinder-846be456-b9ae-4e8c-bdb3-67675710c9cb-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-7e4a61a2-974e-49b8-b1d9-0c515482ffbc tempest-VolumeQuotasAdminTestJSON-1362601535 None] Lock "cinder-846be456-b9ae-4e8c-bdb3-67675710c9cb-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-7e4a61a2-974e-49b8-b1d9-0c515482ffbc tempest-VolumeQuotasAdminTestJSON-1362601535 None] Acquiring lock "cinder-quobyte-846be456-b9ae-4e8c-bdb3-67675710c9cb" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-7e4a61a2-974e-49b8-b1d9-0c515482ffbc tempest-VolumeQuotasAdminTestJSON-1362601535 None] Lock "cinder-quobyte-846be456-b9ae-4e8c-bdb3-67675710c9cb" acquired by "delete_volume" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:22 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[433741f5-ab49-4459-947b-e8d2554313aa]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7e4a61a2-974e-49b8-b1d9-0c515482ffbc tempest-VolumeQuotasAdminTestJSON-1362601535 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-846be456-b9ae-4e8c-bdb3-67675710c9cb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:22 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-846be456-b9ae-4e8c-bdb3-67675710c9cb Jul 08 01:09:22 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:22 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD" returned: 1 in 1.008s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:09:22 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] 4feb86a4-1801-4445-84b1-35c75aad91a4 was raw, converting to raw {{(pid=87123) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:09:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:22 devstack sudo[97111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f Jul 08 01:09:22 devstack sudo[97111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:22 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596 -F qcow2" returned: 0 in 1.103s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-quobyte-0a063f3e-36c0-42ee-b365-514f2d15b47e" released by "_delete_snapshot" :: held 8.838s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-quobyte-6e2e4938-9e36-49ce-b66e-ed81aec24d83" released by "delete_snapshot" :: held 8.870s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:23 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Created reservations ['f8ded0dc-2b5a-4847-997c-b2c713c5bc7b', '1139f8ec-9e71-4f6e-b7b7-df38ee9d43fd', 'ab2db0bb-275a-41ef-8cd4-4814ae124681', 'efa3acd5-0ad5-446b-8c72-86980af3d9b7'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:09:23 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Delete snapshot completed successfully. Jul 08 01:09:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-0a063f3e-36c0-42ee-b365-514f2d15b47e-delete_snapshot" released by "delete_snapshot" :: held 9.128s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "cinder-a6483026-1927-4242-9d15-f053abf58596-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-a6483026-1927-4242-9d15-f053abf58596-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:23 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7e4a61a2-974e-49b8-b1d9-0c515482ffbc tempest-VolumeQuotasAdminTestJSON-1362601535 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-846be456-b9ae-4e8c-bdb3-67675710c9cb" returned: 0 in 1.051s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "cinder-quobyte-6e2e4938-9e36-49ce-b66e-ed81aec24d83" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7e4a61a2-974e-49b8-b1d9-0c515482ffbc tempest-VolumeQuotasAdminTestJSON-1362601535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-846be456-b9ae-4e8c-bdb3-67675710c9cb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-quobyte-6e2e4938-9e36-49ce-b66e-ed81aec24d83" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "cinder-quobyte-a6483026-1927-4242-9d15-f053abf58596" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:23 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-846be456-b9ae-4e8c-bdb3-67675710c9cb Jul 08 01:09:23 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-quobyte-a6483026-1927-4242-9d15-f053abf58596" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Deleting offline snapshot a6483026-1927-4242-9d15-f053abf58596 of volume 6e2e4938-9e36-49ce-b66e-ed81aec24d83 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:09:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] snapshot_file for this snap is: volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:09:23 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[f274cee7-3678-47b9-a109-08f75d65e75b]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:23 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596 Jul 08 01:09:23 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:23 devstack sudo[97111]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f" returned: 0 in 1.150s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:23 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4feb86a4-1801-4445-84b1-35c75aad91a4_p3ir3emjdevstack@QuobyteHD, size 0.00 MB, duration 1.15 sec, destination /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:09:23 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 01:09:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:23 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f 1G Jul 08 01:09:23 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:24 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7e4a61a2-974e-49b8-b1d9-0c515482ffbc tempest-VolumeQuotasAdminTestJSON-1362601535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-846be456-b9ae-4e8c-bdb3-67675710c9cb" returned: 0 in 0.856s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-7e4a61a2-974e-49b8-b1d9-0c515482ffbc tempest-VolumeQuotasAdminTestJSON-1362601535 None] Lock "cinder-quobyte-846be456-b9ae-4e8c-bdb3-67675710c9cb" released by "delete_volume" :: held 1.973s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:24 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-7e4a61a2-974e-49b8-b1d9-0c515482ffbc tempest-VolumeQuotasAdminTestJSON-1362601535 None] Created reservations ['fd29043d-2490-4d02-a7d5-39b9eb24c952', '37585e27-5b1d-4d85-bb77-83487c01d464', '494aa22f-b4e3-499d-ab4b-fd8998e749b4', '520fb744-713c-4e55-8336-42ec41e519c3'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:09:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7e4a61a2-974e-49b8-b1d9-0c515482ffbc tempest-VolumeQuotasAdminTestJSON-1362601535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7e4a61a2-974e-49b8-b1d9-0c515482ffbc tempest-VolumeQuotasAdminTestJSON-1362601535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7e4a61a2-974e-49b8-b1d9-0c515482ffbc tempest-VolumeQuotasAdminTestJSON-1362601535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7e4a61a2-974e-49b8-b1d9-0c515482ffbc tempest-VolumeQuotasAdminTestJSON-1362601535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7e4a61a2-974e-49b8-b1d9-0c515482ffbc tempest-VolumeQuotasAdminTestJSON-1362601535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:24 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7e4a61a2-974e-49b8-b1d9-0c515482ffbc tempest-VolumeQuotasAdminTestJSON-1362601535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596" returned: 0 in 0.997s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:09:24 devstack sudo[97135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:09:24 devstack sudo[97135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:24 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd53321-e1ea-48a4-9871-a3f48e8d7eee]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:24 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 Jul 08 01:09:24 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:24 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f 1G" returned: 0 in 1.210s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:24 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a46252b-9e76-401d-bee4-21b7a4c4b3ac]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:25 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f Jul 08 01:09:25 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Flow 'volume_create_manager' (6acdaf28-3a88-4706-a82d-ccdb5e95d2c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b37bc08-d467-4a47-b870-4f4b690e6ad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b37bc08-d467-4a47-b870-4f4b690e6ad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1257067889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bff4330-1b29-4148-b145-853587e216cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45777aed7f8a4e1b81786e084dbdc8a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:25Z,use_quota=True,user_id='2c872665df8d43f9b74b248bacee234b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ff8832-d826-46ce-845e-24f2c509266d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ff8832-d826-46ce-845e-24f2c509266d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a07d50c-53e9-416e-ab3f-8299cf6185cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a07d50c-53e9-416e-ab3f-8299cf6185cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bff4330-1b29-4148-b145-853587e216cf', 'volume_name': 'volume-8bff4330-1b29-4148-b145-853587e216cf', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8887f9-6d53-4ce8-a53d-f651c769495d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b8887f9-6d53-4ce8-a53d-f651c769495d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b89508-9cd0-4e6f-8b41-ab05b5ae1cb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:25 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Volume 8bff4330-1b29-4148-b145-853587e216cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bff4330-1b29-4148-b145-853587e216cf', 'volume_size': 1} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1257067889',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bff4330-1b29-4148-b145-853587e216cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45777aed7f8a4e1b81786e084dbdc8a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:25Z,use_quota=True,user_id='2c872665df8d43f9b74b248bacee234b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Creating volume 8bff4330-1b29-4148-b145-853587e216cf {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:09:25 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8bff4330-1b29-4148-b145-853587e216cf 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:25 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8bff4330-1b29-4148-b145-853587e216cf 1073741824 Jul 08 01:09:25 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:25 devstack sudo[97135]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7e4a61a2-974e-49b8-b1d9-0c515482ffbc tempest-VolumeQuotasAdminTestJSON-1362601535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.193s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-7e4a61a2-974e-49b8-b1d9-0c515482ffbc tempest-VolumeQuotasAdminTestJSON-1362601535 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:09:25 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-7e4a61a2-974e-49b8-b1d9-0c515482ffbc tempest-VolumeQuotasAdminTestJSON-1362601535 None] Deleted volume successfully. Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-7e4a61a2-974e-49b8-b1d9-0c515482ffbc tempest-VolumeQuotasAdminTestJSON-1362601535 None] Lock "cinder-846be456-b9ae-4e8c-bdb3-67675710c9cb-delete_volume" released by "delete_volume" :: held 3.501s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:25 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83" returned: 0 in 1.556s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:25 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596 Jul 08 01:09:25 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:26 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f" returned: 0 in 1.053s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:26 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f Jul 08 01:09:26 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:26 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8bff4330-1b29-4148-b145-853587e216cf 1073741824" returned: 0 in 1.154s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8bff4330-1b29-4148-b145-853587e216cf {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:26 devstack sudo[97160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8bff4330-1b29-4148-b145-853587e216cf Jul 08 01:09:26 devstack sudo[97160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:26 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f" returned: 1 in 0.902s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:09:26 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Downloaded image 4feb86a4-1801-4445-84b1-35c75aad91a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/4feb86a4-1801-4445-84b1-35c75aad91a4', 'metadata': {}}])) to volume d6cadb94-2e9c-4701-8b51-705eb64ee13f successfully. {{(pid=87123) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:09:26 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Temporary image 4feb86a4-1801-4445-84b1-35c75aad91a4 for user 41e8aaf2d63f4ad5b6c4b8f9488662ea is deleted. {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:09:26 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Marking volume d6cadb94-2e9c-4701-8b51-705eb64ee13f as bootable. {{(pid=87123) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:09:27 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Copying metadata from image 4feb86a4-1801-4445-84b1-35c75aad91a4 to d6cadb94-2e9c-4701-8b51-705eb64ee13f. {{(pid=87123) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:09:27 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Creating volume glance metadata for volume d6cadb94-2e9c-4701-8b51-705eb64ee13f backed by image 4feb86a4-1801-4445-84b1-35c75aad91a4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4feb86a4-1801-4445-84b1-35c75aad91a4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'df1eccb73db12839e303ff9b14a71514', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87123) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:09:27 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596" returned: 0 in 1.160s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:27 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596 Jul 08 01:09:27 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (101ebb0a-5c5a-4464-a03c-0085bb4a804b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f', 'volume_size': 1, 'image_id': '4feb86a4-1801-4445-84b1-35c75aad91a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4feb86a4-1801-4445-84b1-35c75aad91a4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'df1eccb73db12839e303ff9b14a71514', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '5cafacdecb5942718bb64ff897b944e4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '20fc6363a672fdba74777decf89f924d1b35978d96dec75121d2694c562b03ada3501a5801ec51a1272cdc6814c21d004d5e7eebb9a8bec915102101a8394a5b', 'id': '4feb86a4-1801-4445-84b1-35c75aad91a4', 'created_at': datetime.datetime(2026, 7, 7, 23, 9, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 9, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4feb86a4-1801-4445-84b1-35c75aad91a4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d5f8a7-fb76-47bf-b83b-1abf1a005889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:27 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Volume volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f (d6cadb94-2e9c-4701-8b51-705eb64ee13f): created successfully Jul 08 01:09:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79d5f8a7-fb76-47bf-b83b-1abf1a005889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Flow 'volume_create_manager' (ef6f05a0-0959-4480-8e82-5401517d3275) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:27 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-5c8527a1-21ac-4f01-b626-dcc8c8fee665 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Created volume successfully. Jul 08 01:09:27 devstack sudo[97160]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8bff4330-1b29-4148-b145-853587e216cf" returned: 0 in 0.957s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] <== create_volume: return (2169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:09:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.172s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80b89508-9cd0-4e6f-8b41-ab05b5ae1cb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bff4330-1b29-4148-b145-853587e216cf', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6269df-1608-43c2-8491-4f42b8c8a1c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:27 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Volume volume-8bff4330-1b29-4148-b145-853587e216cf (8bff4330-1b29-4148-b145-853587e216cf): created successfully Jul 08 01:09:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6269df-1608-43c2-8491-4f42b8c8a1c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Flow 'volume_create_manager' (6acdaf28-3a88-4706-a82d-ccdb5e95d2c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:27 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-be1a72c7-968a-4a4a-8906-76a44bb47dd0 tempest-VolumeQuotasAdminTestJSON-1362601535 None] Created volume successfully. Jul 08 01:09:27 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83.a6483026-1927-4242-9d15-f053abf58596" returned: 0 in 0.739s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:27 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-quobyte-a6483026-1927-4242-9d15-f053abf58596" released by "_delete_snapshot" :: held 4.616s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:27 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-quobyte-6e2e4938-9e36-49ce-b66e-ed81aec24d83" released by "delete_snapshot" :: held 4.641s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:27 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Created reservations ['f984cb79-1e90-420d-b9a8-bc386dfb7efe', 'e166d576-e2fc-4c6e-98c2-b1b34355d539', 'c3ff5189-31ff-4e3f-a70f-8769c13e7e34', '60768faf-8b91-4beb-af6f-43f9cf7a7b66'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:09:27 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Delete snapshot completed successfully. Jul 08 01:09:27 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-a6483026-1927-4242-9d15-f053abf58596-delete_snapshot" released by "delete_snapshot" :: held 4.830s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Snapshots deleted, issuing volume delete {{(pid=87123) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 01:09:27 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "cinder-quobyte-6e2e4938-9e36-49ce-b66e-ed81aec24d83" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-quobyte-6e2e4938-9e36-49ce-b66e-ed81aec24d83" acquired by "delete_volume" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:28 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dde810f-eeb7-48f6-8c0b-ec65588589a9]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Acquiring lock "cinder-d6cadb94-2e9c-4701-8b51-705eb64ee13f-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Lock "cinder-d6cadb94-2e9c-4701-8b51-705eb64ee13f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:28 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 Jul 08 01:09:28 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Acquiring lock "cinder-quobyte-d6cadb94-2e9c-4701-8b51-705eb64ee13f" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Lock "cinder-quobyte-d6cadb94-2e9c-4701-8b51-705eb64ee13f" acquired by "delete_volume" :: waited 0.022s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:28 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[170d25b0-8c46-4f78-bdd7-989da1fbbe37]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:28 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f Jul 08 01:09:28 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:29 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83" returned: 0 in 1.018s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:29 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83 Jul 08 01:09:29 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:29 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f" returned: 0 in 0.953s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:29 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-9b7a04e8-0ad1-4617-ba8b-f229ce6c733c tempest-VolumeQuotasAdminTestJSON-1541514685 None] Transfer volume completed successfully. Jul 08 01:09:29 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f Jul 08 01:09:29 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:29 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6e2e4938-9e36-49ce-b66e-ed81aec24d83" returned: 0 in 0.853s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:29 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-quobyte-6e2e4938-9e36-49ce-b66e-ed81aec24d83" released by "delete_volume" :: held 1.979s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:30 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Created reservations ['8de35154-681b-499c-9f7e-76a335523f4a', 'de9591d3-d0b2-45f1-acc3-c06f1755d583', '8291696f-b1ac-497a-86fc-664cbee10dbc', 'dde0e857-6a77-48d3-86aa-42659fb6ae71'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:09:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:30 devstack sudo[97192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:09:30 devstack sudo[97192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:30 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f" returned: 1 in 0.995s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:09:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:30 devstack sudo[97194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f Jul 08 01:09:30 devstack sudo[97194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:30 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-7a974617-b81d-490a-b55c-db646dbc95ec tempest-VolumeQuotasAdminTestJSON-175367446 None] Acquiring lock "cinder-8bff4330-1b29-4148-b145-853587e216cf-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:30 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-7a974617-b81d-490a-b55c-db646dbc95ec tempest-VolumeQuotasAdminTestJSON-175367446 None] Lock "cinder-8bff4330-1b29-4148-b145-853587e216cf-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:30 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-7a974617-b81d-490a-b55c-db646dbc95ec tempest-VolumeQuotasAdminTestJSON-175367446 None] Acquiring lock "cinder-quobyte-8bff4330-1b29-4148-b145-853587e216cf" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:30 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-7a974617-b81d-490a-b55c-db646dbc95ec tempest-VolumeQuotasAdminTestJSON-175367446 None] Lock "cinder-quobyte-8bff4330-1b29-4148-b145-853587e216cf" acquired by "delete_volume" :: waited 0.024s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:30 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb998dc-325b-4a2d-9c96-0b5970a6418e]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7a974617-b81d-490a-b55c-db646dbc95ec tempest-VolumeQuotasAdminTestJSON-175367446 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8bff4330-1b29-4148-b145-853587e216cf {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:30 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8bff4330-1b29-4148-b145-853587e216cf Jul 08 01:09:30 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:30 devstack sudo[97192]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.769s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:30 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:09:30 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Deleted volume successfully. Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd5b1e35-d915-4a90-97c9-68fc5a202a7f tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-6e2e4938-9e36-49ce-b66e-ed81aec24d83-delete_volume" released by "delete_volume" :: held 17.144s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:31 devstack sudo[97194]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d6cadb94-2e9c-4701-8b51-705eb64ee13f" returned: 0 in 0.877s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Lock "cinder-quobyte-d6cadb94-2e9c-4701-8b51-705eb64ee13f" released by "delete_volume" :: held 2.917s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:31 devstack cinder-volume[87123]: WARNING cinder.quota [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:09:31 devstack cinder-volume[87123]: WARNING cinder.quota [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Created reservations ['41b90d6f-f5a8-40f4-b982-6b635f4864ce', '6ef1ad3b-ed48-49d6-86ea-c97aba269d26', '7bc4deab-11d6-48fc-a824-9c4a4813ef17', '730d1084-5c69-4331-aafa-2f13e732b1c0'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:31 devstack sudo[97200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:09:31 devstack sudo[97200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Flow 'volume_create_manager' (ad76559b-ab89-43f1-8ca4-8bab7c200ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e1b203-30e5-4b5a-9675-11f3ac64b770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-baeb3d23-3c5b-4e9c-87f2-ccf096b5f95f tempest-BackendsCapabilitiesAdminTestsJSON-637159903 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6468620300293, 'free_capacity_gb': 1775.6468620300293, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87123) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00e1b203-30e5-4b5a-9675-11f3ac64b770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-155192075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7747ed47-cfb4-4fe0-8111-cada0a0b9e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a754d8a407244bd18877f1da57fd410e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:32Z,use_quota=True,user_id='5b51ffa7fe0148858c07dc828b0c50bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911c1586-952b-437b-b7d5-b9c977f009d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (911c1586-952b-437b-b7d5-b9c977f009d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f487f1c-9177-46ae-8d68-68997815e6b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f487f1c-9177-46ae-8d68-68997815e6b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7747ed47-cfb4-4fe0-8111-cada0a0b9e4c', 'volume_name': 'volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f762461-aa40-459c-acfb-856b55795d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f762461-aa40-459c-acfb-856b55795d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676eee3e-1597-4ff6-8dea-1e5822981288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:31 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Volume 7747ed47-cfb4-4fe0-8111-cada0a0b9e4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c', 'volume_size': 1} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-155192075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7747ed47-cfb4-4fe0-8111-cada0a0b9e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a754d8a407244bd18877f1da57fd410e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:32Z,use_quota=True,user_id='5b51ffa7fe0148858c07dc828b0c50bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Creating volume 7747ed47-cfb4-4fe0-8111-cada0a0b9e4c {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:09:31 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:31 devstack sudo[97205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c 1073741824 Jul 08 01:09:31 devstack sudo[97205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:31 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7a974617-b81d-490a-b55c-db646dbc95ec tempest-VolumeQuotasAdminTestJSON-175367446 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8bff4330-1b29-4148-b145-853587e216cf" returned: 0 in 1.089s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7a974617-b81d-490a-b55c-db646dbc95ec tempest-VolumeQuotasAdminTestJSON-175367446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8bff4330-1b29-4148-b145-853587e216cf {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:31 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8bff4330-1b29-4148-b145-853587e216cf Jul 08 01:09:31 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-704e091d-ed18-4082-91e2-908f38e4ca22 tempest-BackendsCapabilitiesAdminTestsJSON-637159903 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6468620300293, 'free_capacity_gb': 1775.6468620300293, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87123) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 01:09:32 devstack sudo[97200]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.001s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:32 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:09:32 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Deleted volume successfully. Jul 08 01:09:32 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-cd76a0f9-4df8-413e-9fa1-db1e74728b77 tempest-VolumeAndVolumeTypeFromImageTest-1691418556 None] Lock "cinder-d6cadb94-2e9c-4701-8b51-705eb64ee13f-delete_volume" released by "delete_volume" :: held 4.290s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:32 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7a974617-b81d-490a-b55c-db646dbc95ec tempest-VolumeQuotasAdminTestJSON-175367446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8bff4330-1b29-4148-b145-853587e216cf" returned: 0 in 0.873s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:32 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-7a974617-b81d-490a-b55c-db646dbc95ec tempest-VolumeQuotasAdminTestJSON-175367446 None] Lock "cinder-quobyte-8bff4330-1b29-4148-b145-853587e216cf" released by "delete_volume" :: held 2.029s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:32 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-7a974617-b81d-490a-b55c-db646dbc95ec tempest-VolumeQuotasAdminTestJSON-175367446 None] Created reservations ['ddf142d8-e798-4e1f-983b-80fa15089fb2', '28f666be-e611-430e-95dc-922ee0796a69', '261f8ea1-0dba-4b05-a01e-60c1d35610ea', '84bbfd10-9128-4a5f-8010-21c7e05e63ae'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:09:32 devstack sudo[97205]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c 1073741824" returned: 0 in 1.234s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7a974617-b81d-490a-b55c-db646dbc95ec tempest-VolumeQuotasAdminTestJSON-175367446 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7a974617-b81d-490a-b55c-db646dbc95ec tempest-VolumeQuotasAdminTestJSON-175367446 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7a974617-b81d-490a-b55c-db646dbc95ec tempest-VolumeQuotasAdminTestJSON-175367446 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7a974617-b81d-490a-b55c-db646dbc95ec tempest-VolumeQuotasAdminTestJSON-175367446 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7a974617-b81d-490a-b55c-db646dbc95ec tempest-VolumeQuotasAdminTestJSON-175367446 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7a974617-b81d-490a-b55c-db646dbc95ec tempest-VolumeQuotasAdminTestJSON-175367446 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:33 devstack sudo[97215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:09:33 devstack sudo[97215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:33 devstack sudo[97217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c Jul 08 01:09:33 devstack sudo[97217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:33 devstack sudo[97217]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c" returned: 0 in 0.895s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] <== create_volume: return (2234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:09:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.239s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (676eee3e-1597-4ff6-8dea-1e5822981288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee74d5c-c7dd-4cc4-b355-210c7251a1c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:34 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Volume volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c (7747ed47-cfb4-4fe0-8111-cada0a0b9e4c): created successfully Jul 08 01:09:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ee74d5c-c7dd-4cc4-b355-210c7251a1c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Flow 'volume_create_manager' (ad76559b-ab89-43f1-8ca4-8bab7c200ff8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:34 devstack sudo[97215]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7a974617-b81d-490a-b55c-db646dbc95ec tempest-VolumeQuotasAdminTestJSON-175367446 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.040s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:34 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-7a974617-b81d-490a-b55c-db646dbc95ec tempest-VolumeQuotasAdminTestJSON-175367446 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:09:34 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-7a974617-b81d-490a-b55c-db646dbc95ec tempest-VolumeQuotasAdminTestJSON-175367446 None] Deleted volume successfully. Jul 08 01:09:34 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-763c3c13-a7ff-470c-9669-affdf720ac4a tempest-VolumesDeleteCascade-164193008 None] Created volume successfully. Jul 08 01:09:34 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-7a974617-b81d-490a-b55c-db646dbc95ec tempest-VolumeQuotasAdminTestJSON-175367446 None] Lock "cinder-8bff4330-1b29-4148-b145-853587e216cf-delete_volume" released by "delete_volume" :: held 3.415s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:35 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=131,cinder:UPDATE=149,cinder:INSERT=47,cinder:DELETE=9 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:09:35 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=118,cinder:UPDATE=149,cinder:DELETE=12,cinder:INSERT=46 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:09:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f96ddcd8-f4ba-4c98-93bd-60aa84c0f1e4 tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f96ddcd8-f4ba-4c98-93bd-60aa84c0f1e4 tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f96ddcd8-f4ba-4c98-93bd-60aa84c0f1e4 tempest-VolumesDeleteCascade-164193008 None] Creating offline snapshot 11a4fe62-e0e5-4aeb-9744-ca53ac0ac557 of volume 7747ed47-cfb4-4fe0-8111-cada0a0b9e4c {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:09:35 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf2b557-c61f-4816-8e3e-5c7d11ab701b]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f96ddcd8-f4ba-4c98-93bd-60aa84c0f1e4 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:35 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c Jul 08 01:09:35 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:36 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f96ddcd8-f4ba-4c98-93bd-60aa84c0f1e4 tempest-VolumesDeleteCascade-164193008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c" returned: 0 in 1.026s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f96ddcd8-f4ba-4c98-93bd-60aa84c0f1e4 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:36 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557 1G Jul 08 01:09:36 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:37 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f96ddcd8-f4ba-4c98-93bd-60aa84c0f1e4 tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557 1G" returned: 0 in 1.122s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f96ddcd8-f4ba-4c98-93bd-60aa84c0f1e4 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:37 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557 Jul 08 01:09:37 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:38 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f96ddcd8-f4ba-4c98-93bd-60aa84c0f1e4 tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557" returned: 0 in 1.086s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:38 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-f96ddcd8-f4ba-4c98-93bd-60aa84c0f1e4 tempest-VolumesDeleteCascade-164193008 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557 is being set with open permissions: ugo+rw Jul 08 01:09:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f96ddcd8-f4ba-4c98-93bd-60aa84c0f1e4 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:38 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557 Jul 08 01:09:38 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:39 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f96ddcd8-f4ba-4c98-93bd-60aa84c0f1e4 tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557" returned: 0 in 0.779s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f96ddcd8-f4ba-4c98-93bd-60aa84c0f1e4 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:39 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.info Jul 08 01:09:39 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:39 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:09:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Flow 'volume_create_manager' (7c5174c9-07d0-40fe-bd4e-f798d8e99d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a6120b-6674-4aeb-b45c-88a5004bddcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58a6120b-6674-4aeb-b45c-88a5004bddcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-651268859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c59339-c33c-4691-bbb6-155a0bd92f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ff3e13c04441229306a70a2322d3a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:40Z,use_quota=True,user_id='92ee1c7d70eb436b82fdb2e6a7be8e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be8cdae-51c1-479e-b37d-a229a1cfa62f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6be8cdae-51c1-479e-b37d-a229a1cfa62f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (197f867c-1b1a-436f-901e-bdf4f0b42ffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (197f867c-1b1a-436f-901e-bdf4f0b42ffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35c59339-c33c-4691-bbb6-155a0bd92f0a', 'volume_name': 'volume-35c59339-c33c-4691-bbb6-155a0bd92f0a', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (548c779e-c4da-4caa-9c57-13d051db0beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (548c779e-c4da-4caa-9c57-13d051db0beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28bfa725-bde6-4973-93eb-34513597b558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:40 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Volume 35c59339-c33c-4691-bbb6-155a0bd92f0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35c59339-c33c-4691-bbb6-155a0bd92f0a', 'volume_size': 1} Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:40 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f96ddcd8-f4ba-4c98-93bd-60aa84c0f1e4 tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.info" returned: 0 in 1.001s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:40 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-f96ddcd8-f4ba-4c98-93bd-60aa84c0f1e4 tempest-VolumesDeleteCascade-164193008 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.info is being set with open permissions: ugo+rw Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f96ddcd8-f4ba-4c98-93bd-60aa84c0f1e4 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:40 devstack sudo[97248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.info Jul 08 01:09:40 devstack sudo[97248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Flow 'volume_create_manager' (c4437c02-8c8c-4b97-bf48-aa20db54885d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18419354-3b03-4e9a-a9e5-df7e480a6e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18419354-3b03-4e9a-a9e5-df7e480a6e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1665903289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec410f7a-7d1c-444d-bfd2-f3b48df162f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ff3e13c04441229306a70a2322d3a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:41Z,use_quota=True,user_id='92ee1c7d70eb436b82fdb2e6a7be8e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ddb137-5b07-421a-9e79-4e33884b84be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67ddb137-5b07-421a-9e79-4e33884b84be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dee1339-bd6a-4b56-8692-d4e36e87f043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1dee1339-bd6a-4b56-8692-d4e36e87f043) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec410f7a-7d1c-444d-bfd2-f3b48df162f4', 'volume_name': 'volume-ec410f7a-7d1c-444d-bfd2-f3b48df162f4', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ea5f5c-ae37-4fba-b39c-58d6637ea089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24ea5f5c-ae37-4fba-b39c-58d6637ea089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0827bb2c-1f18-4895-b071-d1c038eac50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:40 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Volume ec410f7a-7d1c-444d-bfd2-f3b48df162f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec410f7a-7d1c-444d-bfd2-f3b48df162f4', 'volume_size': 1} Jul 08 01:09:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Flow 'volume_create_manager' (8fd1f5e2-56d9-47f8-b373-4384b0f02e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7cb1b2-e975-44b1-8507-846229b2b955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7cb1b2-e975-44b1-8507-846229b2b955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-329647422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=803df60b-d272-48c5-97eb-9d2a2366268e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ff3e13c04441229306a70a2322d3a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:41Z,use_quota=True,user_id='92ee1c7d70eb436b82fdb2e6a7be8e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f657d72-660c-413a-aa98-4cd58de5e1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f657d72-660c-413a-aa98-4cd58de5e1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:41 devstack sudo[97248]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d4da8c-5b36-4a41-b7c0-f3cc1122015f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80d4da8c-5b36-4a41-b7c0-f3cc1122015f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '803df60b-d272-48c5-97eb-9d2a2366268e', 'volume_name': 'volume-803df60b-d272-48c5-97eb-9d2a2366268e', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d73dca5-d5de-4e5b-8ab9-6644c48c422a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d73dca5-d5de-4e5b-8ab9-6644c48c422a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c74d3a-35ab-45dd-af75-5743a18a94d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:41 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Volume 803df60b-d272-48c5-97eb-9d2a2366268e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-803df60b-d272-48c5-97eb-9d2a2366268e', 'volume_size': 1} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f96ddcd8-f4ba-4c98-93bd-60aa84c0f1e4 tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.info" returned: 0 in 1.137s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f96ddcd8-f4ba-4c98-93bd-60aa84c0f1e4 tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.336s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.418s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-651268859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35c59339-c33c-4691-bbb6-155a0bd92f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ff3e13c04441229306a70a2322d3a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:40Z,use_quota=True,user_id='92ee1c7d70eb436b82fdb2e6a7be8e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Creating volume 35c59339-c33c-4691-bbb6-155a0bd92f0a {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:09:41 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-35c59339-c33c-4691-bbb6-155a0bd92f0a 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:41 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-35c59339-c33c-4691-bbb6-155a0bd92f0a 1073741824 Jul 08 01:09:41 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:41 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f96ddcd8-f4ba-4c98-93bd-60aa84c0f1e4 tempest-VolumesDeleteCascade-164193008 None] Create snapshot completed successfully Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Flow 'volume_create_manager' (9b6a6512-50ac-4b2b-950c-f5bb8f2434e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f7a9e0-0d38-4ff4-966a-d5f065adda16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87f7a9e0-0d38-4ff4-966a-d5f065adda16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-191638407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9105a6ec-8259-4088-9579-00e3c220b51b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ff3e13c04441229306a70a2322d3a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:42Z,use_quota=True,user_id='92ee1c7d70eb436b82fdb2e6a7be8e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c1a653-f4ae-4f32-be17-b774e8c25c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c1a653-f4ae-4f32-be17-b774e8c25c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2673eaf0-2654-4956-a2e5-2d95d0938a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2673eaf0-2654-4956-a2e5-2d95d0938a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9105a6ec-8259-4088-9579-00e3c220b51b', 'volume_name': 'volume-9105a6ec-8259-4088-9579-00e3c220b51b', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c2bd43-7eee-4bf5-89ae-562faba7a035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00c2bd43-7eee-4bf5-89ae-562faba7a035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e552f7-86cd-4d60-8422-b998ded45685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:42 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Volume 9105a6ec-8259-4088-9579-00e3c220b51b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9105a6ec-8259-4088-9579-00e3c220b51b', 'volume_size': 1} Jul 08 01:09:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:42 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:09:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Flow 'volume_create_manager' (6b7bb1e5-c89a-46a4-b905-25ffcaa8ddc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43fc667b-0949-47ee-97ed-b3756e3ab032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43fc667b-0949-47ee-97ed-b3756e3ab032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1195208453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2d63613-61b2-4580-8b9b-98ece6528344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ff3e13c04441229306a70a2322d3a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:42Z,use_quota=True,user_id='92ee1c7d70eb436b82fdb2e6a7be8e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a130e0c-c68e-4c2d-b2f7-1ef2d9c8b7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a130e0c-c68e-4c2d-b2f7-1ef2d9c8b7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2666dc-87de-42dd-8403-2a9e5bc731b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d2666dc-87de-42dd-8403-2a9e5bc731b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2d63613-61b2-4580-8b9b-98ece6528344', 'volume_name': 'volume-f2d63613-61b2-4580-8b9b-98ece6528344', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3641b26-dcf3-41ad-b2d3-30872230e8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3641b26-dcf3-41ad-b2d3-30872230e8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4900e768-7c85-4f23-8009-82c291118c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:42 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Volume f2d63613-61b2-4580-8b9b-98ece6528344: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2d63613-61b2-4580-8b9b-98ece6528344', 'volume_size': 1} Jul 08 01:09:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:42 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-35c59339-c33c-4691-bbb6-155a0bd92f0a 1073741824" returned: 0 in 1.316s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-35c59339-c33c-4691-bbb6-155a0bd92f0a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:42 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-35c59339-c33c-4691-bbb6-155a0bd92f0a Jul 08 01:09:42 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Flow 'volume_create_manager' (89b5a149-0098-4cf2-937c-d1623046ce08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9936be40-c013-4bb1-b815-de9d682455fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9936be40-c013-4bb1-b815-de9d682455fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-958818134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a754d8a407244bd18877f1da57fd410e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=11a4fe62-e0e5-4aeb-9744-ca53ac0ac557,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:43Z,use_quota=True,user_id='5b51ffa7fe0148858c07dc828b0c50bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcdc193a-25b4-49f3-9eec-e1e010788a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcdc193a-25b4-49f3-9eec-e1e010788a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a273dc8-fe1a-4f94-a7d5-eb34386316f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a273dc8-fe1a-4f94-a7d5-eb34386316f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3', 'volume_name': 'volume-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3', 'volume_size': 1, 'snapshot_id': '11a4fe62-e0e5-4aeb-9744-ca53ac0ac557'}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24bfd360-4448-43b3-85b1-c00032f689bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24bfd360-4448-43b3-85b1-c00032f689bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd7f92b-5875-4186-9cf1-7c3d03ad461f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:43 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Volume 62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3', 'volume_size': 1, 'snapshot_id': '11a4fe62-e0e5-4aeb-9744-ca53ac0ac557'} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:43 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-35c59339-c33c-4691-bbb6-155a0bd92f0a" returned: 0 in 0.948s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] <== create_volume: return (2322ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.326s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1665903289',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec410f7a-7d1c-444d-bfd2-f3b48df162f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ff3e13c04441229306a70a2322d3a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:41Z,use_quota=True,user_id='92ee1c7d70eb436b82fdb2e6a7be8e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Creating volume ec410f7a-7d1c-444d-bfd2-f3b48df162f4 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:09:43 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec410f7a-7d1c-444d-bfd2-f3b48df162f4 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:43 devstack sudo[97262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec410f7a-7d1c-444d-bfd2-f3b48df162f4 1073741824 Jul 08 01:09:43 devstack sudo[97262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28bfa725-bde6-4973-93eb-34513597b558) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35c59339-c33c-4691-bbb6-155a0bd92f0a', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b4ff45-2d38-4536-a69e-78e7ce4bde35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:43 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Volume volume-35c59339-c33c-4691-bbb6-155a0bd92f0a (35c59339-c33c-4691-bbb6-155a0bd92f0a): created successfully Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50b4ff45-2d38-4536-a69e-78e7ce4bde35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Flow 'volume_create_manager' (7c5174c9-07d0-40fe-bd4e-f798d8e99d82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:43 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-68887048-3830-43f0-a160-9d3da8952528 tempest-CreateVolumesFromImageTest-1127445621 None] Created volume successfully. Jul 08 01:09:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:09:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:44 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:09:44 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:45 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:09:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Flow 'volume_create_manager' (1e6a985a-4e8b-4f52-a292-42e02519d9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79f0f9f-e183-495f-9473-40909e2cb6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a79f0f9f-e183-495f-9473-40909e2cb6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-997009309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc60cd30-0b06-4cfe-b15c-01f4561657e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c584c33571471e94dfe6ec0bc05c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:45Z,use_quota=True,user_id='2e76463b6f004849a460044b1db1957c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2ec579-733e-440e-8278-365e23096dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da2ec579-733e-440e-8278-365e23096dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (367fe670-c052-4f15-be09-57625b3431c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (367fe670-c052-4f15-be09-57625b3431c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc60cd30-0b06-4cfe-b15c-01f4561657e1', 'volume_name': 'volume-cc60cd30-0b06-4cfe-b15c-01f4561657e1', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (094a265f-db93-4466-8d8b-b6ff9e83aee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (094a265f-db93-4466-8d8b-b6ff9e83aee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01dd09f8-8f33-4b66-bb1c-dd62e877b6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:45 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Volume cc60cd30-0b06-4cfe-b15c-01f4561657e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc60cd30-0b06-4cfe-b15c-01f4561657e1', 'volume_size': 1} Jul 08 01:09:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:45 devstack sudo[97262]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec410f7a-7d1c-444d-bfd2-f3b48df162f4 1073741824" returned: 0 in 1.288s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec410f7a-7d1c-444d-bfd2-f3b48df162f4 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:45 devstack sudo[97269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec410f7a-7d1c-444d-bfd2-f3b48df162f4 Jul 08 01:09:45 devstack sudo[97269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:45 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.024s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:45 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:09:45 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:09:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 28 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:09:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:09:46 devstack sudo[97269]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec410f7a-7d1c-444d-bfd2-f3b48df162f4" returned: 0 in 0.811s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] <== create_volume: return (2158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:09:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.162s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.532s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-329647422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=803df60b-d272-48c5-97eb-9d2a2366268e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ff3e13c04441229306a70a2322d3a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:41Z,use_quota=True,user_id='92ee1c7d70eb436b82fdb2e6a7be8e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:09:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Creating volume 803df60b-d272-48c5-97eb-9d2a2366268e {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:09:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:09:46 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:09:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-803df60b-d272-48c5-97eb-9d2a2366268e 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:46 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-803df60b-d272-48c5-97eb-9d2a2366268e 1073741824 Jul 08 01:09:46 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0827bb2c-1f18-4895-b071-d1c038eac50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec410f7a-7d1c-444d-bfd2-f3b48df162f4', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578e1a4f-2e6b-4a78-bf55-da021ee6a825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:46 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Volume volume-ec410f7a-7d1c-444d-bfd2-f3b48df162f4 (ec410f7a-7d1c-444d-bfd2-f3b48df162f4): created successfully Jul 08 01:09:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578e1a4f-2e6b-4a78-bf55-da021ee6a825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Flow 'volume_create_manager' (c4437c02-8c8c-4b97-bf48-aa20db54885d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:46 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-47a480b6-2809-42f6-8c96-353d468147c7 tempest-CreateVolumesFromImageTest-1127445621 None] Created volume successfully. Jul 08 01:09:47 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-803df60b-d272-48c5-97eb-9d2a2366268e 1073741824" returned: 0 in 0.998s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-803df60b-d272-48c5-97eb-9d2a2366268e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:47 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-803df60b-d272-48c5-97eb-9d2a2366268e Jul 08 01:09:47 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:47 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-803df60b-d272-48c5-97eb-9d2a2366268e" returned: 0 in 0.770s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] <== create_volume: return (1817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:09:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.823s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-191638407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9105a6ec-8259-4088-9579-00e3c220b51b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ff3e13c04441229306a70a2322d3a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:42Z,use_quota=True,user_id='92ee1c7d70eb436b82fdb2e6a7be8e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:09:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Creating volume 9105a6ec-8259-4088-9579-00e3c220b51b {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:09:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:09:47 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:09:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9105a6ec-8259-4088-9579-00e3c220b51b 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:47 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9105a6ec-8259-4088-9579-00e3c220b51b 1073741824 Jul 08 01:09:47 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7c74d3a-35ab-45dd-af75-5743a18a94d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-803df60b-d272-48c5-97eb-9d2a2366268e', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1191c8e7-eeb4-4d9b-93f2-e4dda4c9fa3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:47 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Volume volume-803df60b-d272-48c5-97eb-9d2a2366268e (803df60b-d272-48c5-97eb-9d2a2366268e): created successfully Jul 08 01:09:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1191c8e7-eeb4-4d9b-93f2-e4dda4c9fa3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Flow 'volume_create_manager' (8fd1f5e2-56d9-47f8-b373-4384b0f02e7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:47 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-82a10653-7de1-47fd-a588-6de9a7ec34df tempest-CreateVolumesFromImageTest-1127445621 None] Created volume successfully. Jul 08 01:09:48 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9105a6ec-8259-4088-9579-00e3c220b51b 1073741824" returned: 0 in 0.952s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9105a6ec-8259-4088-9579-00e3c220b51b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:48 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9105a6ec-8259-4088-9579-00e3c220b51b Jul 08 01:09:48 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:49 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9105a6ec-8259-4088-9579-00e3c220b51b" returned: 0 in 0.729s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:49 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:09:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.953s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:49 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1195208453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2d63613-61b2-4580-8b9b-98ece6528344,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ff3e13c04441229306a70a2322d3a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:42Z,use_quota=True,user_id='92ee1c7d70eb436b82fdb2e6a7be8e45',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:09:49 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Creating volume f2d63613-61b2-4580-8b9b-98ece6528344 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:09:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:49 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:49 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:49 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:09:49 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:09:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2d63613-61b2-4580-8b9b-98ece6528344 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:49 devstack sudo[97291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2d63613-61b2-4580-8b9b-98ece6528344 1073741824 Jul 08 01:09:49 devstack sudo[97291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:49 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7e552f7-86cd-4d60-8422-b998ded45685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9105a6ec-8259-4088-9579-00e3c220b51b', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:49 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e32a16-f4b5-4fd0-b546-87320c37d2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:49 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Volume volume-9105a6ec-8259-4088-9579-00e3c220b51b (9105a6ec-8259-4088-9579-00e3c220b51b): created successfully Jul 08 01:09:49 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5e32a16-f4b5-4fd0-b546-87320c37d2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:49 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Flow 'volume_create_manager' (9b6a6512-50ac-4b2b-950c-f5bb8f2434e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:49 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-6c13cc55-f75a-4b33-abba-00f058548b59 tempest-CreateVolumesFromImageTest-1127445621 None] Created volume successfully. Jul 08 01:09:50 devstack sudo[97291]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2d63613-61b2-4580-8b9b-98ece6528344 1073741824" returned: 0 in 1.116s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2d63613-61b2-4580-8b9b-98ece6528344 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:50 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2d63613-61b2-4580-8b9b-98ece6528344 Jul 08 01:09:50 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:51 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2d63613-61b2-4580-8b9b-98ece6528344" returned: 0 in 0.833s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] <== create_volume: return (2005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.969s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "cinder-quobyte-11a4fe62-e0e5-4aeb-9744-ca53ac0ac557-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3" by "_create_volume_from_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4900e768-7c85-4f23-8009-82c291118c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2d63613-61b2-4580-8b9b-98ece6528344', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104e53cf-16a9-4970-9a0f-b6e4d93a54ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-quobyte-11a4fe62-e0e5-4aeb-9744-ca53ac0ac557-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Creating volume 62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3 from snapshot 11a4fe62-e0e5-4aeb-9744-ca53ac0ac557 {{(pid=87123) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "cinder-quobyte-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3" by "_copy_volume_from_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:51 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Volume volume-f2d63613-61b2-4580-8b9b-98ece6528344 (f2d63613-61b2-4580-8b9b-98ece6528344): created successfully Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104e53cf-16a9-4970-9a0f-b6e4d93a54ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Flow 'volume_create_manager' (6b7bb1e5-c89a-46a4-b905-25ffcaa8ddc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-quobyte-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] snapshot: 11a4fe62-e0e5-4aeb-9744-ca53ac0ac557, volume: 62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3, {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:09:51 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-bf709f14-4497-4b87-bb20-d3ac2594bb10 tempest-CreateVolumesFromImageTest-1127445621 None] Created volume successfully. Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4565dc-e5c6-417a-bbe1-f0b10d5bd7f6]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:51 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557 Jul 08 01:09:51 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5a0cf35f-1e8c-4a95-b580-0030cca0bbd9 tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "cinder-f2d63613-61b2-4580-8b9b-98ece6528344-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:52 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557" returned: 0 in 0.891s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:09:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:09:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Creating direct copy from snapshot {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:09:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5a0cf35f-1e8c-4a95-b580-0030cca0bbd9 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "cinder-f2d63613-61b2-4580-8b9b-98ece6528344-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:52 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[462878c7-c3c2-4213-934b-8c9bc9378425]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5a0cf35f-1e8c-4a95-b580-0030cca0bbd9 tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "cinder-quobyte-f2d63613-61b2-4580-8b9b-98ece6528344" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5a0cf35f-1e8c-4a95-b580-0030cca0bbd9 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "cinder-quobyte-f2d63613-61b2-4580-8b9b-98ece6528344" acquired by "delete_volume" :: waited 0.032s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:52 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7be46a-f690-4747-8ac1-19fd7d13a6d8]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5a0cf35f-1e8c-4a95-b580-0030cca0bbd9 tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2d63613-61b2-4580-8b9b-98ece6528344 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:52 devstack sudo[97307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c Jul 08 01:09:52 devstack sudo[97307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:52 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2d63613-61b2-4580-8b9b-98ece6528344 Jul 08 01:09:52 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:53 devstack sudo[97307]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c" returned: 0 in 0.954s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:53 devstack cinder-volume[87123]: DEBUG cinder.utils [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Path /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3 not found in is_blk_device check {{(pid=87123) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:09:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:53 devstack sudo[97317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3 Jul 08 01:09:53 devstack sudo[97317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:53 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5a0cf35f-1e8c-4a95-b580-0030cca0bbd9 tempest-CreateVolumesFromImageTest-1127445621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2d63613-61b2-4580-8b9b-98ece6528344" returned: 0 in 0.916s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5a0cf35f-1e8c-4a95-b580-0030cca0bbd9 tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2d63613-61b2-4580-8b9b-98ece6528344 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:53 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2d63613-61b2-4580-8b9b-98ece6528344 Jul 08 01:09:53 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:54 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5a0cf35f-1e8c-4a95-b580-0030cca0bbd9 tempest-CreateVolumesFromImageTest-1127445621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2d63613-61b2-4580-8b9b-98ece6528344" returned: 0 in 0.737s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5a0cf35f-1e8c-4a95-b580-0030cca0bbd9 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "cinder-quobyte-f2d63613-61b2-4580-8b9b-98ece6528344" released by "delete_volume" :: held 1.708s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:54 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-5a0cf35f-1e8c-4a95-b580-0030cca0bbd9 tempest-CreateVolumesFromImageTest-1127445621 None] Created reservations ['5fa01263-7010-4fea-b9b1-a32295690f01', '636019e6-3f88-4acd-8a4d-98be715da54f', '514f45e4-8b37-4ce8-be10-8fd36a6b13a9', '3d2dc15c-1a85-4479-8796-c4fe86c45d1e'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:09:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5a0cf35f-1e8c-4a95-b580-0030cca0bbd9 tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5a0cf35f-1e8c-4a95-b580-0030cca0bbd9 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5a0cf35f-1e8c-4a95-b580-0030cca0bbd9 tempest-CreateVolumesFromImageTest-1127445621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5a0cf35f-1e8c-4a95-b580-0030cca0bbd9 tempest-CreateVolumesFromImageTest-1127445621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5a0cf35f-1e8c-4a95-b580-0030cca0bbd9 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5a0cf35f-1e8c-4a95-b580-0030cca0bbd9 tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:54 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:09:54 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:54 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-9a613859-f12c-4c0f-bc06-f1766d4e89b7 tempest-GroupsV314Test-501175671 None] Group tempest-GroupsV314Test-Group-1526768257: creating Jul 08 01:09:54 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-9a613859-f12c-4c0f-bc06-f1766d4e89b7 tempest-GroupsV314Test-501175671 None] Group tempest-GroupsV314Test-Group-1526768257: created successfully Jul 08 01:09:54 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-9a613859-f12c-4c0f-bc06-f1766d4e89b7 tempest-GroupsV314Test-501175671 None] Create group completed successfully. Jul 08 01:09:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5bbfbdd7-36e1-420f-a0d3-73bfc6da36fb tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "cinder-9105a6ec-8259-4088-9579-00e3c220b51b-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5bbfbdd7-36e1-420f-a0d3-73bfc6da36fb tempest-CreateVolumesFromImageTest-1127445621 None] Lock "cinder-9105a6ec-8259-4088-9579-00e3c220b51b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5bbfbdd7-36e1-420f-a0d3-73bfc6da36fb tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "cinder-quobyte-9105a6ec-8259-4088-9579-00e3c220b51b" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:09:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5bbfbdd7-36e1-420f-a0d3-73bfc6da36fb tempest-CreateVolumesFromImageTest-1127445621 None] Lock "cinder-quobyte-9105a6ec-8259-4088-9579-00e3c220b51b" acquired by "delete_volume" :: waited 0.084s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:09:55 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0dec95-4b70-40c4-96df-f3e75e5f97ae]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:09:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5bbfbdd7-36e1-420f-a0d3-73bfc6da36fb tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9105a6ec-8259-4088-9579-00e3c220b51b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:55 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9105a6ec-8259-4088-9579-00e3c220b51b Jul 08 01:09:55 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:56 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5a0cf35f-1e8c-4a95-b580-0030cca0bbd9 tempest-CreateVolumesFromImageTest-1127445621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.918s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:56 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-5a0cf35f-1e8c-4a95-b580-0030cca0bbd9 tempest-CreateVolumesFromImageTest-1127445621 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:09:56 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-5a0cf35f-1e8c-4a95-b580-0030cca0bbd9 tempest-CreateVolumesFromImageTest-1127445621 None] Deleted volume successfully. Jul 08 01:09:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5a0cf35f-1e8c-4a95-b580-0030cca0bbd9 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "cinder-f2d63613-61b2-4580-8b9b-98ece6528344-delete_volume" released by "delete_volume" :: held 3.981s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:57 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5bbfbdd7-36e1-420f-a0d3-73bfc6da36fb tempest-CreateVolumesFromImageTest-1127445621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9105a6ec-8259-4088-9579-00e3c220b51b" returned: 0 in 1.862s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5bbfbdd7-36e1-420f-a0d3-73bfc6da36fb tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9105a6ec-8259-4088-9579-00e3c220b51b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:57 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9105a6ec-8259-4088-9579-00e3c220b51b Jul 08 01:09:57 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:09:57 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:09:57 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Flow 'volume_create_manager' (ca6cc393-2eaf-4756-b6fa-85aba266a54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:09:57 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a572d47-f21b-49e7-8edf-3370804a3329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:58 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a572d47-f21b-49e7-8edf-3370804a3329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1109822500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=474ed683-b406-4ff6-a00c-32663f0cc22d,host='devstack@QuobyteHD#QuobyteHD',id=b252b853-b616-4caf-a249-54ee877a845e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea4899f6ff84751affae84992f5a6d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:58Z,use_quota=True,user_id='a8f6db4a6ff441f6a78befaf2c0392c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0df4d0e0-a659-4693-b3fc-8534006c22c7),volume_type_id=0df4d0e0-a659-4693-b3fc-8534006c22c7)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:58 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee258ec-8758-4a88-8879-cb17900747db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:58 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ee258ec-8758-4a88-8879-cb17900747db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:58 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5d689a-d093-4180-bdf8-ed6b4a5d3e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:58 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5d689a-d093-4180-bdf8-ed6b4a5d3e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b252b853-b616-4caf-a249-54ee877a845e', 'volume_name': 'volume-b252b853-b616-4caf-a249-54ee877a845e', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:58 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55eae90e-87c9-4a2a-a126-cae958db3405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:58 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55eae90e-87c9-4a2a-a126-cae958db3405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:09:58 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (677df3be-9021-4529-9543-32697ef26b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:09:58 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Volume b252b853-b616-4caf-a249-54ee877a845e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b252b853-b616-4caf-a249-54ee877a845e', 'volume_size': 1} Jul 08 01:09:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:59 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Jul 08 01:09:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5bbfbdd7-36e1-420f-a0d3-73bfc6da36fb tempest-CreateVolumesFromImageTest-1127445621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9105a6ec-8259-4088-9579-00e3c220b51b" returned: 0 in 2.160s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:09:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5bbfbdd7-36e1-420f-a0d3-73bfc6da36fb tempest-CreateVolumesFromImageTest-1127445621 None] Lock "cinder-quobyte-9105a6ec-8259-4088-9579-00e3c220b51b" released by "delete_volume" :: held 4.142s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:09:59 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-5bbfbdd7-36e1-420f-a0d3-73bfc6da36fb tempest-CreateVolumesFromImageTest-1127445621 None] Created reservations ['1c1a790b-ed7e-4674-86ea-897faaaa014a', '380ab1f9-dcbe-45a8-aec9-9f70dfd1d3ab', '1661aa0a-7618-4b4d-bd3e-14c024326956', '5104328a-d347-4d97-9752-e1e2c4c2e587'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:09:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5bbfbdd7-36e1-420f-a0d3-73bfc6da36fb tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:09:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5bbfbdd7-36e1-420f-a0d3-73bfc6da36fb tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:09:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5bbfbdd7-36e1-420f-a0d3-73bfc6da36fb tempest-CreateVolumesFromImageTest-1127445621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:09:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5bbfbdd7-36e1-420f-a0d3-73bfc6da36fb tempest-CreateVolumesFromImageTest-1127445621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:09:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5bbfbdd7-36e1-420f-a0d3-73bfc6da36fb tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:09:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5bbfbdd7-36e1-420f-a0d3-73bfc6da36fb tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:09:59 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:09:59 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:00 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d58ea9f6-d8c8-472c-88db-faff1e1fe681 tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "cinder-803df60b-d272-48c5-97eb-9d2a2366268e-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:00 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d58ea9f6-d8c8-472c-88db-faff1e1fe681 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "cinder-803df60b-d272-48c5-97eb-9d2a2366268e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:00 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d58ea9f6-d8c8-472c-88db-faff1e1fe681 tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "cinder-quobyte-803df60b-d272-48c5-97eb-9d2a2366268e" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:00 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d58ea9f6-d8c8-472c-88db-faff1e1fe681 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "cinder-quobyte-803df60b-d272-48c5-97eb-9d2a2366268e" acquired by "delete_volume" :: waited 0.015s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:00 devstack sudo[97317]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:00 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d556be-cce3-4bd1-9f7f-6815b98d0ac6]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d58ea9f6-d8c8-472c-88db-faff1e1fe681 tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-803df60b-d272-48c5-97eb-9d2a2366268e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3" returned: 0 in 6.614s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:00 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[75b0d5ee-d250-4f46-9ce2-57be0647cc95]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:00 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-803df60b-d272-48c5-97eb-9d2a2366268e Jul 08 01:10:00 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:00 devstack sudo[97348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c Jul 08 01:10:00 devstack sudo[97348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:00 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5bbfbdd7-36e1-420f-a0d3-73bfc6da36fb tempest-CreateVolumesFromImageTest-1127445621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.945s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:00 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-5bbfbdd7-36e1-420f-a0d3-73bfc6da36fb tempest-CreateVolumesFromImageTest-1127445621 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:10:00 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-5bbfbdd7-36e1-420f-a0d3-73bfc6da36fb tempest-CreateVolumesFromImageTest-1127445621 None] Deleted volume successfully. Jul 08 01:10:00 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5bbfbdd7-36e1-420f-a0d3-73bfc6da36fb tempest-CreateVolumesFromImageTest-1127445621 None] Lock "cinder-9105a6ec-8259-4088-9579-00e3c220b51b-delete_volume" released by "delete_volume" :: held 5.776s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:00 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d58ea9f6-d8c8-472c-88db-faff1e1fe681 tempest-CreateVolumesFromImageTest-1127445621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-803df60b-d272-48c5-97eb-9d2a2366268e" returned: 0 in 0.772s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d58ea9f6-d8c8-472c-88db-faff1e1fe681 tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-803df60b-d272-48c5-97eb-9d2a2366268e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:01 devstack sudo[97358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-803df60b-d272-48c5-97eb-9d2a2366268e Jul 08 01:10:01 devstack sudo[97358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:01 devstack sudo[97348]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c" returned: 0 in 0.993s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Image conversion details: src /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c, size 1024.00 MB, duration 6.62 sec, destination /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3 {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:10:01 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Converted 1024.00 MB image at 154.75 MB/s Jul 08 01:10:01 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3 is being set with open permissions: ugo+rw Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:01 devstack sudo[97361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3 Jul 08 01:10:01 devstack sudo[97361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:01 devstack sudo[97358]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d58ea9f6-d8c8-472c-88db-faff1e1fe681 tempest-CreateVolumesFromImageTest-1127445621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-803df60b-d272-48c5-97eb-9d2a2366268e" returned: 0 in 0.719s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d58ea9f6-d8c8-472c-88db-faff1e1fe681 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "cinder-quobyte-803df60b-d272-48c5-97eb-9d2a2366268e" released by "delete_volume" :: held 1.531s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-d58ea9f6-d8c8-472c-88db-faff1e1fe681 tempest-CreateVolumesFromImageTest-1127445621 None] Created reservations ['64fbd8ed-aded-45e7-b6e6-be131037b177', 'a8cd5f8f-b042-4361-82dc-df49dd7fc2bd', '397e6e50-e0ab-4ca2-9a3f-1a485e79a039', 'a1039729-41cd-4ca8-b6a8-4e8ef0d8bc8c'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d58ea9f6-d8c8-472c-88db-faff1e1fe681 tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d58ea9f6-d8c8-472c-88db-faff1e1fe681 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d58ea9f6-d8c8-472c-88db-faff1e1fe681 tempest-CreateVolumesFromImageTest-1127445621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d58ea9f6-d8c8-472c-88db-faff1e1fe681 tempest-CreateVolumesFromImageTest-1127445621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d58ea9f6-d8c8-472c-88db-faff1e1fe681 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d58ea9f6-d8c8-472c-88db-faff1e1fe681 tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:01 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:10:01 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:01 devstack sudo[97361]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3" returned: 0 in 0.701s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-quobyte-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3" released by "_copy_volume_from_snapshot" :: held 10.275s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-quobyte-11a4fe62-e0e5-4aeb-9744-ca53ac0ac557-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3" released by "_create_volume_from_snapshot" :: held 10.327s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.365s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.872s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:09:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-997009309',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc60cd30-0b06-4cfe-b15c-01f4561657e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='36c584c33571471e94dfe6ec0bc05c70',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:45Z,use_quota=True,user_id='2e76463b6f004849a460044b1db1957c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Creating volume cc60cd30-0b06-4cfe-b15c-01f4561657e1 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:10:01 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:10:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cc60cd30-0b06-4cfe-b15c-01f4561657e1 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:02 devstack sudo[97367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cc60cd30-0b06-4cfe-b15c-01f4561657e1 1073741824 Jul 08 01:10:02 devstack sudo[97367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cd7f92b-5875-4186-9cf1-7c3d03ad461f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3', 'volume_size': 1, 'snapshot_id': '11a4fe62-e0e5-4aeb-9744-ca53ac0ac557'}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d87d2b6-2091-4809-a8b2-f805fb3f2b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:02 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Volume volume-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3 (62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3): created successfully Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d87d2b6-2091-4809-a8b2-f805fb3f2b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Flow 'volume_create_manager' (89b5a149-0098-4cf2-937c-d1623046ce08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:02 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-0444a2e5-ff6d-4cef-a288-280b7fc2695d tempest-VolumesDeleteCascade-164193008 None] Created volume successfully. Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-36a9f64c-6dc6-4e42-81b5-a78ffafcd57c tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "cinder-ec410f7a-7d1c-444d-bfd2-f3b48df162f4-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-36a9f64c-6dc6-4e42-81b5-a78ffafcd57c tempest-CreateVolumesFromImageTest-1127445621 None] Lock "cinder-ec410f7a-7d1c-444d-bfd2-f3b48df162f4-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "cinder-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-36a9f64c-6dc6-4e42-81b5-a78ffafcd57c tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "cinder-quobyte-ec410f7a-7d1c-444d-bfd2-f3b48df162f4" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-36a9f64c-6dc6-4e42-81b5-a78ffafcd57c tempest-CreateVolumesFromImageTest-1127445621 None] Lock "cinder-quobyte-ec410f7a-7d1c-444d-bfd2-f3b48df162f4" acquired by "delete_volume" :: waited 0.031s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:02 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d58ea9f6-d8c8-472c-88db-faff1e1fe681 tempest-CreateVolumesFromImageTest-1127445621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.783s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-d58ea9f6-d8c8-472c-88db-faff1e1fe681 tempest-CreateVolumesFromImageTest-1127445621 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25e94de-7d70-4f3f-93df-b2bb57a6b223]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-36a9f64c-6dc6-4e42-81b5-a78ffafcd57c tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec410f7a-7d1c-444d-bfd2-f3b48df162f4 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:02 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-d58ea9f6-d8c8-472c-88db-faff1e1fe681 tempest-CreateVolumesFromImageTest-1127445621 None] Deleted volume successfully. Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Performing cascade delete. {{(pid=87123) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "cinder-11a4fe62-e0e5-4aeb-9744-ca53ac0ac557-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d58ea9f6-d8c8-472c-88db-faff1e1fe681 tempest-CreateVolumesFromImageTest-1127445621 None] Lock "cinder-803df60b-d272-48c5-97eb-9d2a2366268e-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-11a4fe62-e0e5-4aeb-9744-ca53ac0ac557-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "cinder-quobyte-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-quobyte-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "cinder-quobyte-11a4fe62-e0e5-4aeb-9744-ca53ac0ac557" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-quobyte-11a4fe62-e0e5-4aeb-9744-ca53ac0ac557" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Deleting offline snapshot 11a4fe62-e0e5-4aeb-9744-ca53ac0ac557 of volume 7747ed47-cfb4-4fe0-8111-cada0a0b9e4c {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] snapshot_file for this snap is: volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:10:02 devstack sudo[97373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec410f7a-7d1c-444d-bfd2-f3b48df162f4 Jul 08 01:10:02 devstack sudo[97373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[5870362d-fd82-4842-9a54-b4a57f730acd]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:02 devstack sudo[97376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557 Jul 08 01:10:02 devstack sudo[97376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:03 devstack sudo[97367]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cc60cd30-0b06-4cfe-b15c-01f4561657e1 1073741824" returned: 0 in 1.051s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cc60cd30-0b06-4cfe-b15c-01f4561657e1 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:03 devstack sudo[97378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cc60cd30-0b06-4cfe-b15c-01f4561657e1 Jul 08 01:10:03 devstack sudo[97378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:03 devstack sudo[97373]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-36a9f64c-6dc6-4e42-81b5-a78ffafcd57c tempest-CreateVolumesFromImageTest-1127445621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec410f7a-7d1c-444d-bfd2-f3b48df162f4" returned: 0 in 0.917s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-36a9f64c-6dc6-4e42-81b5-a78ffafcd57c tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec410f7a-7d1c-444d-bfd2-f3b48df162f4 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:03 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec410f7a-7d1c-444d-bfd2-f3b48df162f4 Jul 08 01:10:03 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:03 devstack sudo[97378]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cc60cd30-0b06-4cfe-b15c-01f4561657e1" returned: 0 in 0.722s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] <== create_volume: return (1820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.824s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.658s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=474ed683-b406-4ff6-a00c-32663f0cc22d,created_at=2026-07-07T23:09:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1109822500',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=474ed683-b406-4ff6-a00c-32663f0cc22d,host='devstack@QuobyteHD#QuobyteHD',id=b252b853-b616-4caf-a249-54ee877a845e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aea4899f6ff84751affae84992f5a6d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:09:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:09:58Z,use_quota=True,user_id='a8f6db4a6ff441f6a78befaf2c0392c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0df4d0e0-a659-4693-b3fc-8534006c22c7),volume_type_id=0df4d0e0-a659-4693-b3fc-8534006c22c7)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Creating volume b252b853-b616-4caf-a249-54ee877a845e {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:10:03 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:03 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e 1073741824 Jul 08 01:10:03 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01dd09f8-8f33-4b66-bb1c-dd62e877b6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc60cd30-0b06-4cfe-b15c-01f4561657e1', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:03 devstack sudo[97376]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8e58b4-d379-41cc-9246-378e3855d674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557" returned: 0 in 1.013s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:10:03 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Volume volume-cc60cd30-0b06-4cfe-b15c-01f4561657e1 (cc60cd30-0b06-4cfe-b15c-01f4561657e1): created successfully Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8e58b4-d379-41cc-9246-378e3855d674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Flow 'volume_create_manager' (1e6a985a-4e8b-4f52-a292-42e02519d9cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5fa738-935b-47b8-b761-2135bab1d2ea]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:03 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-d9812185-7a69-499a-a451-f7125d5739af tempest-VolumesServicesTestJSON-36154335 None] Created volume successfully. Jul 08 01:10:04 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c Jul 08 01:10:04 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:04 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-36a9f64c-6dc6-4e42-81b5-a78ffafcd57c tempest-CreateVolumesFromImageTest-1127445621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ec410f7a-7d1c-444d-bfd2-f3b48df162f4" returned: 0 in 0.773s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:04 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-36a9f64c-6dc6-4e42-81b5-a78ffafcd57c tempest-CreateVolumesFromImageTest-1127445621 None] Lock "cinder-quobyte-ec410f7a-7d1c-444d-bfd2-f3b48df162f4" released by "delete_volume" :: held 1.765s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:04 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-36a9f64c-6dc6-4e42-81b5-a78ffafcd57c tempest-CreateVolumesFromImageTest-1127445621 None] Created reservations ['59114cf8-3b7d-4c31-91e8-6a0a223edd66', 'dd1b2cd0-1515-49a2-a488-562826eac53a', '326b89aa-1f39-4bfb-91f0-d36fbf693a12', '0e87c828-9426-41ba-bc66-b460915cdd10'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:10:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-36a9f64c-6dc6-4e42-81b5-a78ffafcd57c tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-36a9f64c-6dc6-4e42-81b5-a78ffafcd57c tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:04 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-36a9f64c-6dc6-4e42-81b5-a78ffafcd57c tempest-CreateVolumesFromImageTest-1127445621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:04 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-36a9f64c-6dc6-4e42-81b5-a78ffafcd57c tempest-CreateVolumesFromImageTest-1127445621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-36a9f64c-6dc6-4e42-81b5-a78ffafcd57c tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-36a9f64c-6dc6-4e42-81b5-a78ffafcd57c tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:04 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:10:04 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:04 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8351cd12-b48b-4314-bcfe-5d711f4100bb tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "cinder-35c59339-c33c-4691-bbb6-155a0bd92f0a-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:04 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:04 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8351cd12-b48b-4314-bcfe-5d711f4100bb tempest-CreateVolumesFromImageTest-1127445621 None] Lock "cinder-35c59339-c33c-4691-bbb6-155a0bd92f0a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c" returned: 0 in 1.006s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:04 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557 Jul 08 01:10:04 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:04 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8351cd12-b48b-4314-bcfe-5d711f4100bb tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "cinder-quobyte-35c59339-c33c-4691-bbb6-155a0bd92f0a" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:05 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:05 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8351cd12-b48b-4314-bcfe-5d711f4100bb tempest-CreateVolumesFromImageTest-1127445621 None] Lock "cinder-quobyte-35c59339-c33c-4691-bbb6-155a0bd92f0a" acquired by "delete_volume" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e 1073741824" returned: 0 in 1.226s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:05 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b3ce7fc-005a-4067-aa0b-cf12ac40ae9c]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8351cd12-b48b-4314-bcfe-5d711f4100bb tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-35c59339-c33c-4691-bbb6-155a0bd92f0a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:05 devstack sudo[97406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e Jul 08 01:10:05 devstack sudo[97406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:05 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-35c59339-c33c-4691-bbb6-155a0bd92f0a Jul 08 01:10:05 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:05 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd3ef572-4f98-490b-8df6-c3de541b09e0 tempest-VolumesServicesTestJSON-36154335 None] Acquiring lock "cinder-cc60cd30-0b06-4cfe-b15c-01f4561657e1-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:05 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd3ef572-4f98-490b-8df6-c3de541b09e0 tempest-VolumesServicesTestJSON-36154335 None] Lock "cinder-cc60cd30-0b06-4cfe-b15c-01f4561657e1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:05 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd3ef572-4f98-490b-8df6-c3de541b09e0 tempest-VolumesServicesTestJSON-36154335 None] Acquiring lock "cinder-quobyte-cc60cd30-0b06-4cfe-b15c-01f4561657e1" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:05 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd3ef572-4f98-490b-8df6-c3de541b09e0 tempest-VolumesServicesTestJSON-36154335 None] Lock "cinder-quobyte-cc60cd30-0b06-4cfe-b15c-01f4561657e1" acquired by "delete_volume" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:05 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-36a9f64c-6dc6-4e42-81b5-a78ffafcd57c tempest-CreateVolumesFromImageTest-1127445621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.883s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:05 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-36a9f64c-6dc6-4e42-81b5-a78ffafcd57c tempest-CreateVolumesFromImageTest-1127445621 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:10:05 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-36a9f64c-6dc6-4e42-81b5-a78ffafcd57c tempest-CreateVolumesFromImageTest-1127445621 None] Deleted volume successfully. Jul 08 01:10:05 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a349c1-aef4-47de-8e86-fa051bd07a44]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd3ef572-4f98-490b-8df6-c3de541b09e0 tempest-VolumesServicesTestJSON-36154335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cc60cd30-0b06-4cfe-b15c-01f4561657e1 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:05 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-36a9f64c-6dc6-4e42-81b5-a78ffafcd57c tempest-CreateVolumesFromImageTest-1127445621 None] Lock "cinder-ec410f7a-7d1c-444d-bfd2-f3b48df162f4-delete_volume" released by "delete_volume" :: held 2.958s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:05 devstack sudo[97410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cc60cd30-0b06-4cfe-b15c-01f4561657e1 Jul 08 01:10:05 devstack sudo[97410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557" returned: 0 in 1.022s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:05 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:05 devstack sudo[97416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557 Jul 08 01:10:05 devstack sudo[97416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:06 devstack sudo[97406]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e" returned: 0 in 1.023s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:06 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] <== create_volume: return (2326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:10:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.329s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:06 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (677df3be-9021-4529-9543-32697ef26b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b252b853-b616-4caf-a249-54ee877a845e', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578e0034-5c64-45e3-8938-d1f406c9a9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8351cd12-b48b-4314-bcfe-5d711f4100bb tempest-CreateVolumesFromImageTest-1127445621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-35c59339-c33c-4691-bbb6-155a0bd92f0a" returned: 0 in 1.113s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8351cd12-b48b-4314-bcfe-5d711f4100bb tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-35c59339-c33c-4691-bbb6-155a0bd92f0a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:06 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Volume volume-b252b853-b616-4caf-a249-54ee877a845e (b252b853-b616-4caf-a249-54ee877a845e): created successfully Jul 08 01:10:06 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-35c59339-c33c-4691-bbb6-155a0bd92f0a Jul 08 01:10:06 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (578e0034-5c64-45e3-8938-d1f406c9a9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Flow 'volume_create_manager' (ca6cc393-2eaf-4756-b6fa-85aba266a54e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:06 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-2970e86f-da55-4cdf-8e84-dc45db81e388 tempest-GroupsV314Test-501175671 None] Created volume successfully. Jul 08 01:10:06 devstack sudo[97410]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd3ef572-4f98-490b-8df6-c3de541b09e0 tempest-VolumesServicesTestJSON-36154335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cc60cd30-0b06-4cfe-b15c-01f4561657e1" returned: 0 in 0.900s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd3ef572-4f98-490b-8df6-c3de541b09e0 tempest-VolumesServicesTestJSON-36154335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cc60cd30-0b06-4cfe-b15c-01f4561657e1 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:06 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cc60cd30-0b06-4cfe-b15c-01f4561657e1 Jul 08 01:10:06 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:06 devstack sudo[97416]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c.11a4fe62-e0e5-4aeb-9744-ca53ac0ac557" returned: 0 in 0.806s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:06 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-quobyte-11a4fe62-e0e5-4aeb-9744-ca53ac0ac557" released by "_delete_snapshot" :: held 3.969s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:06 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-quobyte-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c" released by "delete_snapshot" :: held 4.003s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:06 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Created reservations ['7928fadf-ef49-4bfd-a041-f177f2cd5bf1', 'bf8e1fe4-a7d8-407c-a53b-c513e407647d', '130eb037-7aca-443c-8498-73bd0dbfaeeb', '68bb79f5-d5d5-442c-99eb-e67ab3e02811'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:10:06 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8351cd12-b48b-4314-bcfe-5d711f4100bb tempest-CreateVolumesFromImageTest-1127445621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-35c59339-c33c-4691-bbb6-155a0bd92f0a" returned: 0 in 0.708s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:06 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8351cd12-b48b-4314-bcfe-5d711f4100bb tempest-CreateVolumesFromImageTest-1127445621 None] Lock "cinder-quobyte-35c59339-c33c-4691-bbb6-155a0bd92f0a" released by "delete_volume" :: held 1.876s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:06 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Delete snapshot completed successfully. Jul 08 01:10:06 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-11a4fe62-e0e5-4aeb-9744-ca53ac0ac557-delete_snapshot" released by "delete_snapshot" :: held 4.203s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Snapshots deleted, issuing volume delete {{(pid=87123) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 08 01:10:06 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "cinder-quobyte-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:06 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-quobyte-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c" acquired by "delete_volume" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:07 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-8351cd12-b48b-4314-bcfe-5d711f4100bb tempest-CreateVolumesFromImageTest-1127445621 None] Created reservations ['50098b3b-cc7a-4271-955c-baa940aab87c', 'a80d91af-380b-4b5c-9e8c-78ad21008f27', '213a420d-fc9e-4d8d-9a1c-4c7d80417439', 'af4e4491-b0c2-44f7-9266-ab7bfb46d3d5'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:10:07 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[b974a814-d142-4fce-9443-75a6c81181df]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:07 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd3ef572-4f98-490b-8df6-c3de541b09e0 tempest-VolumesServicesTestJSON-36154335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cc60cd30-0b06-4cfe-b15c-01f4561657e1" returned: 0 in 0.749s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd3ef572-4f98-490b-8df6-c3de541b09e0 tempest-VolumesServicesTestJSON-36154335 None] Lock "cinder-quobyte-cc60cd30-0b06-4cfe-b15c-01f4561657e1" released by "delete_volume" :: held 1.730s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:07 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c Jul 08 01:10:07 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8351cd12-b48b-4314-bcfe-5d711f4100bb tempest-CreateVolumesFromImageTest-1127445621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8351cd12-b48b-4314-bcfe-5d711f4100bb tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-8351cd12-b48b-4314-bcfe-5d711f4100bb tempest-CreateVolumesFromImageTest-1127445621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-8351cd12-b48b-4314-bcfe-5d711f4100bb tempest-CreateVolumesFromImageTest-1127445621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8351cd12-b48b-4314-bcfe-5d711f4100bb tempest-CreateVolumesFromImageTest-1127445621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8351cd12-b48b-4314-bcfe-5d711f4100bb tempest-CreateVolumesFromImageTest-1127445621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:07 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:10:07 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:07 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-fd3ef572-4f98-490b-8df6-c3de541b09e0 tempest-VolumesServicesTestJSON-36154335 None] Created reservations ['2fb55d14-13c7-41a8-b581-15daf5d5b47b', '75b21c4d-5034-4562-94af-6fec60a06447', 'b95fc2f9-e8a1-46ea-bd2a-a456257e60bd', '2d6df0ba-528a-4a18-84f7-20e4745e4677'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:10:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fd3ef572-4f98-490b-8df6-c3de541b09e0 tempest-VolumesServicesTestJSON-36154335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fd3ef572-4f98-490b-8df6-c3de541b09e0 tempest-VolumesServicesTestJSON-36154335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-fd3ef572-4f98-490b-8df6-c3de541b09e0 tempest-VolumesServicesTestJSON-36154335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-fd3ef572-4f98-490b-8df6-c3de541b09e0 tempest-VolumesServicesTestJSON-36154335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fd3ef572-4f98-490b-8df6-c3de541b09e0 tempest-VolumesServicesTestJSON-36154335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd3ef572-4f98-490b-8df6-c3de541b09e0 tempest-VolumesServicesTestJSON-36154335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:07 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:10:07 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:08 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8351cd12-b48b-4314-bcfe-5d711f4100bb tempest-CreateVolumesFromImageTest-1127445621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.973s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:08 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-8351cd12-b48b-4314-bcfe-5d711f4100bb tempest-CreateVolumesFromImageTest-1127445621 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:10:08 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-8351cd12-b48b-4314-bcfe-5d711f4100bb tempest-CreateVolumesFromImageTest-1127445621 None] Deleted volume successfully. Jul 08 01:10:08 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8351cd12-b48b-4314-bcfe-5d711f4100bb tempest-CreateVolumesFromImageTest-1127445621 None] Lock "cinder-35c59339-c33c-4691-bbb6-155a0bd92f0a-delete_volume" released by "delete_volume" :: held 3.298s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:08 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c" returned: 0 in 1.285s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:08 devstack sudo[97442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c Jul 08 01:10:08 devstack sudo[97442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:08 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Cloning volume b252b853-b616-4caf-a249-54ee877a845e to volume 2f43268d-1771-4178-b69b-95286696b176 Jul 08 01:10:08 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Creating offline snapshot 97fbf4b3-231c-4a95-b13d-4209e5e833be of volume b252b853-b616-4caf-a249-54ee877a845e {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:10:08 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd9c722-40ff-47e5-8f80-c9dea889d13c]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:08 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fd3ef572-4f98-490b-8df6-c3de541b09e0 tempest-VolumesServicesTestJSON-36154335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.226s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:08 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-fd3ef572-4f98-490b-8df6-c3de541b09e0 tempest-VolumesServicesTestJSON-36154335 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:10:08 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-fd3ef572-4f98-490b-8df6-c3de541b09e0 tempest-VolumesServicesTestJSON-36154335 None] Deleted volume successfully. Jul 08 01:10:08 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fd3ef572-4f98-490b-8df6-c3de541b09e0 tempest-VolumesServicesTestJSON-36154335 None] Lock "cinder-cc60cd30-0b06-4cfe-b15c-01f4561657e1-delete_volume" released by "delete_volume" :: held 3.450s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:08 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e Jul 08 01:10:08 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:09 devstack sudo[97442]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c" returned: 0 in 0.973s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-quobyte-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c" released by "delete_volume" :: held 2.336s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:09 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Created reservations ['8c7b0e17-0016-4bf9-b3b7-eb8cd7fb4f22', 'd778ba5b-ea73-4336-bf3d-d4a55b6e30c0', 'd62c3be9-9c6c-425b-9f79-7180f81f52e6', '9b2d607e-2418-4828-890d-4cc28c2bef9d'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:10:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:09 devstack sudo[97448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:10:09 devstack sudo[97448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:09 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e" returned: 0 in 1.294s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:09 devstack sudo[97453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be 1G Jul 08 01:10:09 devstack sudo[97453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:10 devstack sudo[97448]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.956s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:10 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:10:10 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Deleted volume successfully. Jul 08 01:10:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-30010d5e-5057-41f0-a296-506927cfb1d7 tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-7747ed47-cfb4-4fe0-8111-cada0a0b9e4c-delete_volume" released by "delete_volume" :: held 7.957s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-297eb16b-50dd-467d-b154-869f18a18b5d tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "cinder-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-297eb16b-50dd-467d-b154-869f18a18b5d tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-297eb16b-50dd-467d-b154-869f18a18b5d tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "cinder-quobyte-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-297eb16b-50dd-467d-b154-869f18a18b5d tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-quobyte-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3" acquired by "delete_volume" :: waited 0.026s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:10 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4156b8b-ca0a-4ae5-884e-fdcee56fb513]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-297eb16b-50dd-467d-b154-869f18a18b5d tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:10 devstack sudo[97457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3 Jul 08 01:10:10 devstack sudo[97457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:11 devstack sudo[97453]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be 1G" returned: 0 in 1.468s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b252b853-b616-4caf-a249-54ee877a845e -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:11 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b252b853-b616-4caf-a249-54ee877a845e -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be Jul 08 01:10:11 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:12 devstack sudo[97457]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-297eb16b-50dd-467d-b154-869f18a18b5d tempest-VolumesDeleteCascade-164193008 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3" returned: 0 in 1.246s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-297eb16b-50dd-467d-b154-869f18a18b5d tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:12 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3 Jul 08 01:10:12 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:12 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:10:12 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Flow 'volume_create_manager' (096ef642-a077-413d-b5b7-37e82e869f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11b1977-14e6-4139-af69-11bf8aa3deaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b252b853-b616-4caf-a249-54ee877a845e -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be" returned: 0 in 1.364s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:12 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:10:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c11b1977-14e6-4139-af69-11bf8aa3deaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-277840759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e956724-26c1-4d73-a584-c507a871e2f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345f390a55bb48fbb081bed3f93b3d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:13Z,use_quota=True,user_id='0f94d81199de47339e302c835d339626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:12 devstack sudo[97510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be Jul 08 01:10:12 devstack sudo[97510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e5f97d-49b3-48e7-98f8-aa8c97134786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61e5f97d-49b3-48e7-98f8-aa8c97134786) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55fff42f-ce6f-41f5-8d2c-f6dd67f5af4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55fff42f-ce6f-41f5-8d2c-f6dd67f5af4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e956724-26c1-4d73-a584-c507a871e2f3', 'volume_name': 'volume-7e956724-26c1-4d73-a584-c507a871e2f3', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04827ec0-5c60-457b-afc1-6670dced7ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04827ec0-5c60-457b-afc1-6670dced7ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa0e368-70c8-4a9b-ac54-abfbb012d310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:12 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Volume 7e956724-26c1-4d73-a584-c507a871e2f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e956724-26c1-4d73-a584-c507a871e2f3', 'volume_size': 1} Jul 08 01:10:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:13 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-297eb16b-50dd-467d-b154-869f18a18b5d tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3" returned: 0 in 1.048s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-297eb16b-50dd-467d-b154-869f18a18b5d tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-quobyte-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3" released by "delete_volume" :: held 2.359s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:13 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-297eb16b-50dd-467d-b154-869f18a18b5d tempest-VolumesDeleteCascade-164193008 None] Created reservations ['cd430c43-22a4-43e4-a14e-c8a48a555d7e', '4b40d1ab-f4ee-4d9b-b2ae-d3eef7aa97f2', '6e5a88a5-c390-4f2d-ac1d-505b2214b7fa', 'af0ce78b-8473-4862-82af-eb3e62232897'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:10:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-297eb16b-50dd-467d-b154-869f18a18b5d tempest-VolumesDeleteCascade-164193008 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-297eb16b-50dd-467d-b154-869f18a18b5d tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-297eb16b-50dd-467d-b154-869f18a18b5d tempest-VolumesDeleteCascade-164193008 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-297eb16b-50dd-467d-b154-869f18a18b5d tempest-VolumesDeleteCascade-164193008 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-297eb16b-50dd-467d-b154-869f18a18b5d tempest-VolumesDeleteCascade-164193008 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-297eb16b-50dd-467d-b154-869f18a18b5d tempest-VolumesDeleteCascade-164193008 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:13 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:10:13 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:13 devstack sudo[97510]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be" returned: 0 in 0.765s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:13 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.info Jul 08 01:10:13 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:14 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-297eb16b-50dd-467d-b154-869f18a18b5d tempest-VolumesDeleteCascade-164193008 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.780s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:14 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-297eb16b-50dd-467d-b154-869f18a18b5d tempest-VolumesDeleteCascade-164193008 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:10:14 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-297eb16b-50dd-467d-b154-869f18a18b5d tempest-VolumesDeleteCascade-164193008 None] Deleted volume successfully. Jul 08 01:10:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-297eb16b-50dd-467d-b154-869f18a18b5d tempest-VolumesDeleteCascade-164193008 None] Lock "cinder-62f2cbbd-f2f8-4509-b6f6-7a6cf5c5dce3-delete_volume" released by "delete_volume" :: held 3.508s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:14 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.info" returned: 0 in 0.756s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:14 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.info is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:10:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:14 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.info Jul 08 01:10:14 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:15 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.info" returned: 0 in 0.910s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:15 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Acquiring lock "cinder-quobyte-2f43268d-1771-4178-b69b-95286696b176" by "_copy_volume_from_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:15 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Lock "cinder-quobyte-2f43268d-1771-4178-b69b-95286696b176" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] snapshot: 97fbf4b3-231c-4a95-b13d-4209e5e833be, volume: 2f43268d-1771-4178-b69b-95286696b176, {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:10:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:15 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aec31d4-2ffd-4f6c-bb00-25e2167097cb]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:15 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be Jul 08 01:10:15 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:16 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be" returned: 0 in 1.082s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b252b853-b616-4caf-a249-54ee877a845e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:10:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:10:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Creating direct copy from snapshot {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:10:16 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f2149c-b15b-4eee-942c-6840551e83da]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:16 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:10:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Flow 'volume_create_manager' (b72fe091-6a28-4d3d-b07b-dc705ae14cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc2c3362-72b5-4110-8ca6-25f40d0b7584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc2c3362-72b5-4110-8ca6-25f40d0b7584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-210840729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='848a39a5613d4f6ab91347549db5a39b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:16Z,use_quota=True,user_id='1bca0aafcefa420eaa7c3bd6fb9f5078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d84a67e-7abc-44a2-b711-f206b54beb91),volume_type_id=6d84a67e-7abc-44a2-b711-f206b54beb91)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2185104-8e1a-484b-a953-baa0bff5afc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2185104-8e1a-484b-a953-baa0bff5afc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c131fde6-51ab-4bae-8931-5668e2dee68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:16 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e Jul 08 01:10:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c131fde6-51ab-4bae-8931-5668e2dee68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6', 'volume_name': 'volume-abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:16 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960e8d57-dad5-44b1-a29c-874a6cd54d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (960e8d57-dad5-44b1-a29c-874a6cd54d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d73c0ae-f986-4de6-8942-7cf649182e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:16 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Volume abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6', 'volume_size': 1} Jul 08 01:10:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:17 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e" returned: 0 in 0.846s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:17 devstack cinder-volume[87123]: DEBUG cinder.utils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Path /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2f43268d-1771-4178-b69b-95286696b176 not found in is_blk_device check {{(pid=87123) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:10:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2f43268d-1771-4178-b69b-95286696b176 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:17 devstack sudo[97533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2f43268d-1771-4178-b69b-95286696b176 Jul 08 01:10:17 devstack sudo[97533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:23 devstack sudo[97533]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2f43268d-1771-4178-b69b-95286696b176" returned: 0 in 5.918s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:23 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bcb62b-084f-43af-a9ec-5e0d4466247d]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:23 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e Jul 08 01:10:23 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:24 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=75,cinder:UPDATE=96,cinder:INSERT=21,cinder:DELETE=6 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:10:24 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e" returned: 0 in 1.088s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:24 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Image conversion details: src /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e, size 1024.00 MB, duration 5.92 sec, destination /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2f43268d-1771-4178-b69b-95286696b176 {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:10:24 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Converted 1024.00 MB image at 172.99 MB/s Jul 08 01:10:24 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2f43268d-1771-4178-b69b-95286696b176 is being set with open permissions: ugo+rw: NotImplementedError Jul 08 01:10:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2f43268d-1771-4178-b69b-95286696b176 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:24 devstack sudo[97559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2f43268d-1771-4178-b69b-95286696b176 Jul 08 01:10:24 devstack sudo[97559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:25 devstack sudo[97559]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2f43268d-1771-4178-b69b-95286696b176" returned: 0 in 0.856s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Lock "cinder-quobyte-2f43268d-1771-4178-b69b-95286696b176" released by "_copy_volume_from_snapshot" :: held 9.907s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Acquiring lock "cinder-quobyte-97fbf4b3-231c-4a95-b13d-4209e5e833be" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Lock "cinder-quobyte-97fbf4b3-231c-4a95-b13d-4209e5e833be" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Deleting offline snapshot 97fbf4b3-231c-4a95-b13d-4209e5e833be of volume b252b853-b616-4caf-a249-54ee877a845e {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:10:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] snapshot_file for this snap is: volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:10:25 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[002fe30d-45c3-405d-a033-9bcd6f2584a9]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:25 devstack sudo[97562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be Jul 08 01:10:25 devstack sudo[97562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:26 devstack sudo[97562]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be" returned: 0 in 0.820s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:26 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b252b853-b616-4caf-a249-54ee877a845e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:10:26 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2aaba21-1fc7-4dec-a172-0fd3caa7b6a5]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:26 devstack sudo[97567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e Jul 08 01:10:26 devstack sudo[97567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:26 devstack sudo[97567]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e" returned: 0 in 0.823s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:26 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be Jul 08 01:10:26 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:27 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be" returned: 0 in 0.828s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:27 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be Jul 08 01:10:27 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:28 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e.97fbf4b3-231c-4a95-b13d-4209e5e833be" returned: 0 in 0.741s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Lock "cinder-quobyte-97fbf4b3-231c-4a95-b13d-4209e5e833be" released by "_delete_snapshot" :: held 3.327s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 20.034s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.720s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:28 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-277840759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e956724-26c1-4d73-a584-c507a871e2f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345f390a55bb48fbb081bed3f93b3d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:13Z,use_quota=True,user_id='0f94d81199de47339e302c835d339626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:10:28 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Creating volume 7e956724-26c1-4d73-a584-c507a871e2f3 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:10:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:28 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:28 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:28 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:10:28 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:10:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7e956724-26c1-4d73-a584-c507a871e2f3 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:28 devstack sudo[97580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7e956724-26c1-4d73-a584-c507a871e2f3 1073741824 Jul 08 01:10:28 devstack sudo[97580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:28 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-3af54fec-96b4-4854-afbb-13af82f8366e tempest-GroupsV314Test-501175671 None] Create group from source-group-474ed683-b406-4ff6-a00c-32663f0cc22d completed successfully. Jul 08 01:10:29 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-579845cd-2ad8-448d-b187-ad54405f10d0 tempest-GroupsV314Test-501175671 None] Acquiring lock "cinder-quobyte-2f43268d-1771-4178-b69b-95286696b176" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:29 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-579845cd-2ad8-448d-b187-ad54405f10d0 tempest-GroupsV314Test-501175671 None] Lock "cinder-quobyte-2f43268d-1771-4178-b69b-95286696b176" acquired by "delete_volume" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:29 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee48902-b6ba-4f97-a820-b3f59dd1f933]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-579845cd-2ad8-448d-b187-ad54405f10d0 tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2f43268d-1771-4178-b69b-95286696b176 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:29 devstack sudo[97586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2f43268d-1771-4178-b69b-95286696b176 Jul 08 01:10:29 devstack sudo[97586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:29 devstack sudo[97580]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7e956724-26c1-4d73-a584-c507a871e2f3 1073741824" returned: 0 in 1.078s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7e956724-26c1-4d73-a584-c507a871e2f3 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:29 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7e956724-26c1-4d73-a584-c507a871e2f3 Jul 08 01:10:29 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:30 devstack sudo[97586]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-579845cd-2ad8-448d-b187-ad54405f10d0 tempest-GroupsV314Test-501175671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2f43268d-1771-4178-b69b-95286696b176" returned: 0 in 1.003s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-579845cd-2ad8-448d-b187-ad54405f10d0 tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2f43268d-1771-4178-b69b-95286696b176 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:30 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7e956724-26c1-4d73-a584-c507a871e2f3" returned: 0 in 0.780s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] <== create_volume: return (1918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:10:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.914s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-210840729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='848a39a5613d4f6ab91347549db5a39b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:16Z,use_quota=True,user_id='1bca0aafcefa420eaa7c3bd6fb9f5078',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6d84a67e-7abc-44a2-b711-f206b54beb91),volume_type_id=6d84a67e-7abc-44a2-b711-f206b54beb91)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:10:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Creating volume abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:10:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:10:30 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:10:30 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2f43268d-1771-4178-b69b-95286696b176 Jul 08 01:10:30 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:30 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6 1073741824 Jul 08 01:10:30 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaa0e368-70c8-4a9b-ac54-abfbb012d310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e956724-26c1-4d73-a584-c507a871e2f3', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c144b4a-1851-4e3d-bee9-e70c44dacae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:30 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Volume volume-7e956724-26c1-4d73-a584-c507a871e2f3 (7e956724-26c1-4d73-a584-c507a871e2f3): created successfully Jul 08 01:10:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c144b4a-1851-4e3d-bee9-e70c44dacae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Flow 'volume_create_manager' (096ef642-a077-413d-b5b7-37e82e869f98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:30 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-765f752d-98ca-40df-9bb4-e1b4cfd5a0ef tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Created volume successfully. Jul 08 01:10:31 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-579845cd-2ad8-448d-b187-ad54405f10d0 tempest-GroupsV314Test-501175671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2f43268d-1771-4178-b69b-95286696b176" returned: 0 in 0.847s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:31 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-579845cd-2ad8-448d-b187-ad54405f10d0 tempest-GroupsV314Test-501175671 None] Lock "cinder-quobyte-2f43268d-1771-4178-b69b-95286696b176" released by "delete_volume" :: held 1.950s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:31 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-579845cd-2ad8-448d-b187-ad54405f10d0 tempest-GroupsV314Test-501175671 None] Created reservations ['9f0efe3e-d2e4-48dd-9910-1c65c9fc6e3b'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:10:31 devstack cinder-volume[87123]: WARNING cinder.quota [None req-579845cd-2ad8-448d-b187-ad54405f10d0 tempest-GroupsV314Test-501175671 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-2038443185 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-2038443185, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:10:31 devstack cinder-volume[87123]: WARNING cinder.quota [None req-579845cd-2ad8-448d-b187-ad54405f10d0 tempest-GroupsV314Test-501175671 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-2038443185 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-2038443185, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:10:31 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-579845cd-2ad8-448d-b187-ad54405f10d0 tempest-GroupsV314Test-501175671 None] Created reservations ['98e46af6-6ecb-4170-ac11-94f13c410905', '0a959368-bcb6-4165-b396-cb5e3c5ffea6', '80c7e7e5-ea00-446f-b74f-66652b652cc9', '54c8fe6e-4113-4a41-8671-3de2f07acb70'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:10:31 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6 1073741824" returned: 0 in 1.160s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-579845cd-2ad8-448d-b187-ad54405f10d0 tempest-GroupsV314Test-501175671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-579845cd-2ad8-448d-b187-ad54405f10d0 tempest-GroupsV314Test-501175671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-579845cd-2ad8-448d-b187-ad54405f10d0 tempest-GroupsV314Test-501175671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-579845cd-2ad8-448d-b187-ad54405f10d0 tempest-GroupsV314Test-501175671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-579845cd-2ad8-448d-b187-ad54405f10d0 tempest-GroupsV314Test-501175671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-579845cd-2ad8-448d-b187-ad54405f10d0 tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:31 devstack sudo[97604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:10:31 devstack sudo[97604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:31 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6 Jul 08 01:10:31 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Flow 'volume_create_manager' (e4c81eb5-edb1-4ac9-9501-503a2effe277) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13fe177-165e-4a8b-ad68-751a962e3672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13fe177-165e-4a8b-ad68-751a962e3672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-354360759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa078407-931e-4aef-84cd-ec08fe15ff94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345f390a55bb48fbb081bed3f93b3d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:32Z,use_quota=True,user_id='0f94d81199de47339e302c835d339626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc8c1a7-ef6b-423b-9117-126ddd724c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcc8c1a7-ef6b-423b-9117-126ddd724c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda51e1b-0447-4b66-8554-09ba94b6fff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eda51e1b-0447-4b66-8554-09ba94b6fff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa078407-931e-4aef-84cd-ec08fe15ff94', 'volume_name': 'volume-fa078407-931e-4aef-84cd-ec08fe15ff94', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1cf4de7-9fe1-4da0-9287-f14a2515aafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1cf4de7-9fe1-4da0-9287-f14a2515aafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a584433f-4102-4c3c-88d0-04b23e3828e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:32 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Volume fa078407-931e-4aef-84cd-ec08fe15ff94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa078407-931e-4aef-84cd-ec08fe15ff94', 'volume_size': 1} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:10:32 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:32 devstack sudo[97604]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Flow 'volume_create_manager' (a7865d2a-2c25-47bf-947b-1ef148abaad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8864aa5-c136-40f2-8e59-0e0d6ba82371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6" returned: 0 in 0.999s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-579845cd-2ad8-448d-b187-ad54405f10d0 tempest-GroupsV314Test-501175671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.016s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] <== create_volume: return (2248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.251s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-579845cd-2ad8-448d-b187-ad54405f10d0 tempest-GroupsV314Test-501175671 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.353s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-354360759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa078407-931e-4aef-84cd-ec08fe15ff94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345f390a55bb48fbb081bed3f93b3d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:32Z,use_quota=True,user_id='0f94d81199de47339e302c835d339626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Creating volume fa078407-931e-4aef-84cd-ec08fe15ff94 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:10:32 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fa078407-931e-4aef-84cd-ec08fe15ff94 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:32 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-579845cd-2ad8-448d-b187-ad54405f10d0 tempest-GroupsV314Test-501175671 None] Delete group completed successfully. Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d73c0ae-f986-4de6-8942-7cf649182e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:32 devstack sudo[97610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fa078407-931e-4aef-84cd-ec08fe15ff94 1073741824 Jul 08 01:10:32 devstack sudo[97610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50cc45be-0775-45d8-b4a0-fa0b3660f94f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8864aa5-c136-40f2-8e59-0e0d6ba82371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-413601632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345f390a55bb48fbb081bed3f93b3d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:33Z,use_quota=True,user_id='0f94d81199de47339e302c835d339626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04713fe6-e804-47aa-b5dc-7827907dd610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04713fe6-e804-47aa-b5dc-7827907dd610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a36afc-d18c-4255-898b-7226c0e255a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24a36afc-d18c-4255-898b-7226c0e255a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04', 'volume_name': 'volume-9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44add0f8-2942-4fd9-844e-af368a79aa69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44add0f8-2942-4fd9-844e-af368a79aa69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec67a7de-877c-4e45-b78c-80a771e26759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:33 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Volume 9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04', 'volume_size': 1} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:33 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Volume volume-abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6 (abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6): created successfully Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50cc45be-0775-45d8-b4a0-fa0b3660f94f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Flow 'volume_create_manager' (b72fe091-6a28-4d3d-b07b-dc705ae14cb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Flow 'volume_create_manager' (0e2ab259-28ee-4a07-bf6f-9da53cf12fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db5503ff-818e-424b-8284-dec6fcfff4a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:33 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-50e4e244-bbf1-4288-a72e-b05decdf0eb3 tempest-VolumeTypesAccessTest-1129056927 None] Created volume successfully. Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db5503ff-818e-424b-8284-dec6fcfff4a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-467793942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99dce23f-6c80-49ed-858d-bdebbb19cfa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75398dba300547ee9a87441558def11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:33Z,use_quota=True,user_id='6b1a3c2b1b0d4d898a7baa225318d84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163b5df2-2f17-4960-ae1d-02bf3446f35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (163b5df2-2f17-4960-ae1d-02bf3446f35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231af897-89b6-4a92-aa0a-074437dd2ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (231af897-89b6-4a92-aa0a-074437dd2ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99dce23f-6c80-49ed-858d-bdebbb19cfa2', 'volume_name': 'volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76333b1a-5f09-418b-a08c-f9d52ed8c1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76333b1a-5f09-418b-a08c-f9d52ed8c1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0055be85-9aa1-499f-bda8-c6e075f8b539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:33 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Volume 99dce23f-6c80-49ed-858d-bdebbb19cfa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2', 'volume_size': 1} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-255f98b2-8c54-44dc-a1b7-e3f49dd1c50a tempest-GroupsV314Test-501175671 None] Acquiring lock "cinder-quobyte-b252b853-b616-4caf-a249-54ee877a845e" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Flow 'volume_create_manager' (24347693-c072-4e49-bc86-32537cc0bebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc88b839-37fe-4543-b314-d5bc388924a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-255f98b2-8c54-44dc-a1b7-e3f49dd1c50a tempest-GroupsV314Test-501175671 None] Lock "cinder-quobyte-b252b853-b616-4caf-a249-54ee877a845e" acquired by "delete_volume" :: waited 0.075s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc88b839-37fe-4543-b314-d5bc388924a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-576591592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be5a01bc-94db-473e-ba38-b1bc77fbf120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345f390a55bb48fbb081bed3f93b3d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:33Z,use_quota=True,user_id='0f94d81199de47339e302c835d339626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d59a912-678c-43de-a70b-6837709cef0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d59a912-678c-43de-a70b-6837709cef0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de45bf7-0ff3-49e1-bd9b-215f76eeabaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5de45bf7-0ff3-49e1-bd9b-215f76eeabaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be5a01bc-94db-473e-ba38-b1bc77fbf120', 'volume_name': 'volume-be5a01bc-94db-473e-ba38-b1bc77fbf120', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b40f625-62b0-48f3-a8fe-3f2a56f7d18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b40f625-62b0-48f3-a8fe-3f2a56f7d18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b39363-033e-458e-946d-039aa585290a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:33 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Volume be5a01bc-94db-473e-ba38-b1bc77fbf120: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be5a01bc-94db-473e-ba38-b1bc77fbf120', 'volume_size': 1} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[5201dc3c-ed36-4d75-8f37-d18433e46bdf]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-255f98b2-8c54-44dc-a1b7-e3f49dd1c50a tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:33 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e Jul 08 01:10:33 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Flow 'volume_create_manager' (517b55f5-2670-4110-8114-61b88fad7b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d58b69-e6ab-4305-b879-b9e5ff084609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d26a0a44-ecee-45ed-aa18-b8ba78495964 tempest-VolumeTypesAccessTest-1129056927 None] Acquiring lock "cinder-abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6d58b69-e6ab-4305-b879-b9e5ff084609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1073604821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d79e25-0029-4a00-a2c9-12fb0ac4e896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345f390a55bb48fbb081bed3f93b3d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:34Z,use_quota=True,user_id='0f94d81199de47339e302c835d339626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d59e1a2-57fb-4f38-9e7d-3c089b1497d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d59e1a2-57fb-4f38-9e7d-3c089b1497d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e93230f-bcc1-4236-8fe9-0cff65b39497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e93230f-bcc1-4236-8fe9-0cff65b39497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65d79e25-0029-4a00-a2c9-12fb0ac4e896', 'volume_name': 'volume-65d79e25-0029-4a00-a2c9-12fb0ac4e896', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352afd27-901b-405d-a6d3-f16917fcd4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (352afd27-901b-405d-a6d3-f16917fcd4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d102e2-4095-4122-bd2d-e9ca437fda23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:33 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Volume 65d79e25-0029-4a00-a2c9-12fb0ac4e896: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65d79e25-0029-4a00-a2c9-12fb0ac4e896', 'volume_size': 1} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d26a0a44-ecee-45ed-aa18-b8ba78495964 tempest-VolumeTypesAccessTest-1129056927 None] Lock "cinder-abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6-delete_volume" acquired by "delete_volume" :: waited 0.112s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d26a0a44-ecee-45ed-aa18-b8ba78495964 tempest-VolumeTypesAccessTest-1129056927 None] Acquiring lock "cinder-quobyte-abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:33 devstack sudo[97610]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d26a0a44-ecee-45ed-aa18-b8ba78495964 tempest-VolumeTypesAccessTest-1129056927 None] Lock "cinder-quobyte-abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6" acquired by "delete_volume" :: waited 0.029s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fa078407-931e-4aef-84cd-ec08fe15ff94 1073741824" returned: 0 in 1.131s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd40e69-0b33-4d72-9bfc-afdb7d584177]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d26a0a44-ecee-45ed-aa18-b8ba78495964 tempest-VolumeTypesAccessTest-1129056927 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fa078407-931e-4aef-84cd-ec08fe15ff94 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:34 devstack sudo[97621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fa078407-931e-4aef-84cd-ec08fe15ff94 Jul 08 01:10:34 devstack sudo[97621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:34 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6 Jul 08 01:10:34 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Flow 'volume_create_manager' (34573ed9-1421-47b4-8fb3-b7b1aab328f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3823eef-15ec-44c1-b3e5-f522acc86e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3823eef-15ec-44c1-b3e5-f522acc86e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-868456100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51aef0a-125b-404c-858c-a20ce6a024eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345f390a55bb48fbb081bed3f93b3d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:34Z,use_quota=True,user_id='0f94d81199de47339e302c835d339626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b09332-a3cc-4d8f-8ec6-cea16c7f647a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b09332-a3cc-4d8f-8ec6-cea16c7f647a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bdd2bf5-3543-4716-854b-ef406667f1ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bdd2bf5-3543-4716-854b-ef406667f1ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b51aef0a-125b-404c-858c-a20ce6a024eb', 'volume_name': 'volume-b51aef0a-125b-404c-858c-a20ce6a024eb', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21685f35-c135-4b49-b22a-e640bcf3e00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21685f35-c135-4b49-b22a-e640bcf3e00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75bcd530-4534-49cc-876d-9c2c53aa7d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:34 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Volume b51aef0a-125b-404c-858c-a20ce6a024eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b51aef0a-125b-404c-858c-a20ce6a024eb', 'volume_size': 1} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:34 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-255f98b2-8c54-44dc-a1b7-e3f49dd1c50a tempest-GroupsV314Test-501175671 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e" returned: 0 in 1.031s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-255f98b2-8c54-44dc-a1b7-e3f49dd1c50a tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:34 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e Jul 08 01:10:34 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:34 devstack sudo[97621]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fa078407-931e-4aef-84cd-ec08fe15ff94" returned: 0 in 0.726s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.951s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.682s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-413601632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345f390a55bb48fbb081bed3f93b3d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:33Z,use_quota=True,user_id='0f94d81199de47339e302c835d339626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Creating volume 9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:10:34 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:34 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04 1073741824 Jul 08 01:10:34 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a584433f-4102-4c3c-88d0-04b23e3828e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa078407-931e-4aef-84cd-ec08fe15ff94', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf93e6e0-cbea-405f-b3f3-330259f1ef56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:34 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Volume volume-fa078407-931e-4aef-84cd-ec08fe15ff94 (fa078407-931e-4aef-84cd-ec08fe15ff94): created successfully Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf93e6e0-cbea-405f-b3f3-330259f1ef56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Flow 'volume_create_manager' (e4c81eb5-edb1-4ac9-9501-503a2effe277) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:34 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-ec3e91f6-0f0e-4f0a-ab8c-da34e08b5416 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Created volume successfully. Jul 08 01:10:34 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d26a0a44-ecee-45ed-aa18-b8ba78495964 tempest-VolumeTypesAccessTest-1129056927 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6" returned: 0 in 1.004s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d26a0a44-ecee-45ed-aa18-b8ba78495964 tempest-VolumeTypesAccessTest-1129056927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:35 devstack sudo[97635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6 Jul 08 01:10:35 devstack sudo[97635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:35 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-255f98b2-8c54-44dc-a1b7-e3f49dd1c50a tempest-GroupsV314Test-501175671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b252b853-b616-4caf-a249-54ee877a845e" returned: 0 in 0.725s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:35 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-255f98b2-8c54-44dc-a1b7-e3f49dd1c50a tempest-GroupsV314Test-501175671 None] Lock "cinder-quobyte-b252b853-b616-4caf-a249-54ee877a845e" released by "delete_volume" :: held 1.912s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:35 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=92,cinder:UPDATE=124,cinder:DELETE=12,cinder:INSERT=28 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:10:35 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-255f98b2-8c54-44dc-a1b7-e3f49dd1c50a tempest-GroupsV314Test-501175671 None] Created reservations ['bef8e067-7880-4e9f-8cbc-f4f5f61daba4'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:10:35 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-255f98b2-8c54-44dc-a1b7-e3f49dd1c50a tempest-GroupsV314Test-501175671 None] Created reservations ['36ee53d7-3fd8-4409-aecc-2ba4c0cefec8', 'e4b02767-837d-45a7-8f34-53e0f9a82d17', 'a23efac5-eccc-4be7-986c-05d6dbf24a63', '8b9e5efe-e12e-4f20-918c-c21d12c2cc31'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:10:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-255f98b2-8c54-44dc-a1b7-e3f49dd1c50a tempest-GroupsV314Test-501175671 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-255f98b2-8c54-44dc-a1b7-e3f49dd1c50a tempest-GroupsV314Test-501175671 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-255f98b2-8c54-44dc-a1b7-e3f49dd1c50a tempest-GroupsV314Test-501175671 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-255f98b2-8c54-44dc-a1b7-e3f49dd1c50a tempest-GroupsV314Test-501175671 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-255f98b2-8c54-44dc-a1b7-e3f49dd1c50a tempest-GroupsV314Test-501175671 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-255f98b2-8c54-44dc-a1b7-e3f49dd1c50a tempest-GroupsV314Test-501175671 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:35 devstack sudo[97641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:10:35 devstack sudo[97641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:35 devstack sudo[97635]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d26a0a44-ecee-45ed-aa18-b8ba78495964 tempest-VolumeTypesAccessTest-1129056927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6" returned: 0 in 0.752s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:35 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d26a0a44-ecee-45ed-aa18-b8ba78495964 tempest-VolumeTypesAccessTest-1129056927 None] Lock "cinder-quobyte-abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6" released by "delete_volume" :: held 1.817s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:35 devstack cinder-volume[87123]: WARNING cinder.quota [None req-d26a0a44-ecee-45ed-aa18-b8ba78495964 tempest-VolumeTypesAccessTest-1129056927 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-358095481 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-358095481, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:10:35 devstack cinder-volume[87123]: WARNING cinder.quota [None req-d26a0a44-ecee-45ed-aa18-b8ba78495964 tempest-VolumeTypesAccessTest-1129056927 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-358095481 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-358095481, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:10:35 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04 1073741824" returned: 0 in 1.044s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:35 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-d26a0a44-ecee-45ed-aa18-b8ba78495964 tempest-VolumeTypesAccessTest-1129056927 None] Created reservations ['158379cb-a539-4580-a935-9c378f73f828', '5a0d8887-9afd-466a-9d72-bdafb8c8a1a7', '29245a1e-fd32-4b66-9c46-7fe150bd3107', '0b712011-6aaa-4881-ab92-997e063dfabb'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:10:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:35 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04 Jul 08 01:10:35 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d26a0a44-ecee-45ed-aa18-b8ba78495964 tempest-VolumeTypesAccessTest-1129056927 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d26a0a44-ecee-45ed-aa18-b8ba78495964 tempest-VolumeTypesAccessTest-1129056927 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d26a0a44-ecee-45ed-aa18-b8ba78495964 tempest-VolumeTypesAccessTest-1129056927 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d26a0a44-ecee-45ed-aa18-b8ba78495964 tempest-VolumeTypesAccessTest-1129056927 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d26a0a44-ecee-45ed-aa18-b8ba78495964 tempest-VolumeTypesAccessTest-1129056927 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d26a0a44-ecee-45ed-aa18-b8ba78495964 tempest-VolumeTypesAccessTest-1129056927 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:36 devstack sudo[97647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:10:36 devstack sudo[97647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:36 devstack sudo[97641]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-255f98b2-8c54-44dc-a1b7-e3f49dd1c50a tempest-GroupsV314Test-501175671 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.153s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:36 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-255f98b2-8c54-44dc-a1b7-e3f49dd1c50a tempest-GroupsV314Test-501175671 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:10:36 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-255f98b2-8c54-44dc-a1b7-e3f49dd1c50a tempest-GroupsV314Test-501175671 None] Delete group completed successfully. Jul 08 01:10:36 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04" returned: 0 in 1.060s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] <== create_volume: return (2171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:10:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.174s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.660s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-467793942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99dce23f-6c80-49ed-858d-bdebbb19cfa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75398dba300547ee9a87441558def11e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:33Z,use_quota=True,user_id='6b1a3c2b1b0d4d898a7baa225318d84f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:10:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Creating volume 99dce23f-6c80-49ed-858d-bdebbb19cfa2 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:10:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:10:36 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:10:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec67a7de-877c-4e45-b78c-80a771e26759) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ab817c-37f3-41a4-891b-2d982ffb08ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:36 devstack sudo[97652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 1073741824 Jul 08 01:10:36 devstack sudo[97652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:37 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Volume volume-9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04 (9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04): created successfully Jul 08 01:10:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0ab817c-37f3-41a4-891b-2d982ffb08ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Flow 'volume_create_manager' (a7865d2a-2c25-47bf-947b-1ef148abaad1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:37 devstack sudo[97647]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:37 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-9006cf2f-5e53-4200-a5ac-6a8fa6b3f598 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Created volume successfully. Jul 08 01:10:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d26a0a44-ecee-45ed-aa18-b8ba78495964 tempest-VolumeTypesAccessTest-1129056927 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.085s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:37 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-d26a0a44-ecee-45ed-aa18-b8ba78495964 tempest-VolumeTypesAccessTest-1129056927 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:10:37 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-d26a0a44-ecee-45ed-aa18-b8ba78495964 tempest-VolumeTypesAccessTest-1129056927 None] Deleted volume successfully. Jul 08 01:10:37 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d26a0a44-ecee-45ed-aa18-b8ba78495964 tempest-VolumeTypesAccessTest-1129056927 None] Lock "cinder-abb5d2a2-cf7c-4768-8f74-ecfcdb95d3f6-delete_volume" released by "delete_volume" :: held 3.272s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:38 devstack sudo[97652]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 1073741824" returned: 0 in 1.088s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:38 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 Jul 08 01:10:38 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:38 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2" returned: 0 in 0.786s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:10:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.924s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.391s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-576591592',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be5a01bc-94db-473e-ba38-b1bc77fbf120,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345f390a55bb48fbb081bed3f93b3d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:33Z,use_quota=True,user_id='0f94d81199de47339e302c835d339626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:10:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Creating volume be5a01bc-94db-473e-ba38-b1bc77fbf120 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:10:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:10:38 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:10:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-be5a01bc-94db-473e-ba38-b1bc77fbf120 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0055be85-9aa1-499f-bda8-c6e075f8b539) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:38 devstack sudo[97662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-be5a01bc-94db-473e-ba38-b1bc77fbf120 1073741824 Jul 08 01:10:38 devstack sudo[97662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2e2f57-e3a4-44d4-827a-3b4a1c83838a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:38 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Volume volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 (99dce23f-6c80-49ed-858d-bdebbb19cfa2): created successfully Jul 08 01:10:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce2e2f57-e3a4-44d4-827a-3b4a1c83838a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Flow 'volume_create_manager' (0e2ab259-28ee-4a07-bf6f-9da53cf12fa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:38 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-ed9f2325-9926-444e-a1e1-11a46d0389bf tempest-VolumesActionsTest-1485080785 None] Created volume successfully. Jul 08 01:10:39 devstack sudo[97662]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-be5a01bc-94db-473e-ba38-b1bc77fbf120 1073741824" returned: 0 in 1.090s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-be5a01bc-94db-473e-ba38-b1bc77fbf120 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:40 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-be5a01bc-94db-473e-ba38-b1bc77fbf120 Jul 08 01:10:40 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:40 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-be5a01bc-94db-473e-ba38-b1bc77fbf120" returned: 0 in 0.913s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] <== create_volume: return (2065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:10:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.072s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.095s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1073604821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65d79e25-0029-4a00-a2c9-12fb0ac4e896,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345f390a55bb48fbb081bed3f93b3d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:34Z,use_quota=True,user_id='0f94d81199de47339e302c835d339626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:10:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Creating volume 65d79e25-0029-4a00-a2c9-12fb0ac4e896 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:10:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:10:40 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:10:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-65d79e25-0029-4a00-a2c9-12fb0ac4e896 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6b39363-033e-458e-946d-039aa585290a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be5a01bc-94db-473e-ba38-b1bc77fbf120', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:41 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-65d79e25-0029-4a00-a2c9-12fb0ac4e896 1073741824 Jul 08 01:10:41 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756d4ba4-c420-48ef-bd10-161943135af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:41 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Volume volume-be5a01bc-94db-473e-ba38-b1bc77fbf120 (be5a01bc-94db-473e-ba38-b1bc77fbf120): created successfully Jul 08 01:10:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756d4ba4-c420-48ef-bd10-161943135af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Flow 'volume_create_manager' (24347693-c072-4e49-bc86-32537cc0bebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:41 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-d7b799f7-b46f-4b32-bf0b-9a215bb177e1 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Created volume successfully. Jul 08 01:10:42 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-65d79e25-0029-4a00-a2c9-12fb0ac4e896 1073741824" returned: 0 in 1.306s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-65d79e25-0029-4a00-a2c9-12fb0ac4e896 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:42 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-65d79e25-0029-4a00-a2c9-12fb0ac4e896 Jul 08 01:10:42 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:43 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-65d79e25-0029-4a00-a2c9-12fb0ac4e896" returned: 0 in 0.990s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] <== create_volume: return (2364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:10:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.369s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.903s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-868456100',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51aef0a-125b-404c-858c-a20ce6a024eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='345f390a55bb48fbb081bed3f93b3d0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:34Z,use_quota=True,user_id='0f94d81199de47339e302c835d339626',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:10:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Creating volume b51aef0a-125b-404c-858c-a20ce6a024eb {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:10:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:10:43 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:10:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b51aef0a-125b-404c-858c-a20ce6a024eb 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:43 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b51aef0a-125b-404c-858c-a20ce6a024eb 1073741824 Jul 08 01:10:43 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30d102e2-4095-4122-bd2d-e9ca437fda23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65d79e25-0029-4a00-a2c9-12fb0ac4e896', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79eaad3b-21a0-44f2-b312-637c7e3ccb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:43 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Volume volume-65d79e25-0029-4a00-a2c9-12fb0ac4e896 (65d79e25-0029-4a00-a2c9-12fb0ac4e896): created successfully Jul 08 01:10:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79eaad3b-21a0-44f2-b312-637c7e3ccb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Flow 'volume_create_manager' (517b55f5-2670-4110-8114-61b88fad7b15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:43 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-6977c197-2a93-4572-9230-eeff86c392ed tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Created volume successfully. Jul 08 01:10:44 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b51aef0a-125b-404c-858c-a20ce6a024eb 1073741824" returned: 0 in 1.111s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b51aef0a-125b-404c-858c-a20ce6a024eb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:44 devstack sudo[97693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b51aef0a-125b-404c-858c-a20ce6a024eb Jul 08 01:10:44 devstack sudo[97693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:10:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:44 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:10:44 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:45 devstack sudo[97693]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b51aef0a-125b-404c-858c-a20ce6a024eb" returned: 0 in 0.889s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:45 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:10:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.061s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75bcd530-4534-49cc-876d-9c2c53aa7d12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b51aef0a-125b-404c-858c-a20ce6a024eb', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c573b896-dcab-46a4-b7f3-7ca54ec88eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:45 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Volume volume-b51aef0a-125b-404c-858c-a20ce6a024eb (b51aef0a-125b-404c-858c-a20ce6a024eb): created successfully Jul 08 01:10:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c573b896-dcab-46a4-b7f3-7ca54ec88eb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Flow 'volume_create_manager' (34573ed9-1421-47b4-8fb3-b7b1aab328f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:45 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-50993343-bab9-4c4e-95e4-cd166540181a tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Created volume successfully. Jul 08 01:10:45 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.052s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:45 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:10:46 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:10:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 28 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:10:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:10:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c3bee08f-c47f-405d-b17b-2076be1fbf77 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "cinder-b51aef0a-125b-404c-858c-a20ce6a024eb-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c3bee08f-c47f-405d-b17b-2076be1fbf77 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-b51aef0a-125b-404c-858c-a20ce6a024eb-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c3bee08f-c47f-405d-b17b-2076be1fbf77 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "cinder-quobyte-b51aef0a-125b-404c-858c-a20ce6a024eb" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c3bee08f-c47f-405d-b17b-2076be1fbf77 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-quobyte-b51aef0a-125b-404c-858c-a20ce6a024eb" acquired by "delete_volume" :: waited 0.025s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:46 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d12eeb6c-4b5a-404e-9ed8-875e3f3b4913]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c3bee08f-c47f-405d-b17b-2076be1fbf77 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b51aef0a-125b-404c-858c-a20ce6a024eb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:47 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b51aef0a-125b-404c-858c-a20ce6a024eb Jul 08 01:10:47 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:47 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c3bee08f-c47f-405d-b17b-2076be1fbf77 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b51aef0a-125b-404c-858c-a20ce6a024eb" returned: 0 in 1.100s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c3bee08f-c47f-405d-b17b-2076be1fbf77 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b51aef0a-125b-404c-858c-a20ce6a024eb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:48 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b51aef0a-125b-404c-858c-a20ce6a024eb Jul 08 01:10:48 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:48 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c3bee08f-c47f-405d-b17b-2076be1fbf77 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b51aef0a-125b-404c-858c-a20ce6a024eb" returned: 0 in 0.905s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:48 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c3bee08f-c47f-405d-b17b-2076be1fbf77 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-quobyte-b51aef0a-125b-404c-858c-a20ce6a024eb" released by "delete_volume" :: held 2.065s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:49 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-c3bee08f-c47f-405d-b17b-2076be1fbf77 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Created reservations ['3691e727-6465-4461-a103-fb8aadecf9c5', '9c182c2f-ef22-40c0-b6e3-58bcca888c64', '5aa6aea1-f6c2-48ff-9000-5d5c9568952d', '1e7352f2-d834-4651-9707-d7ea9fb1ed51'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:10:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c3bee08f-c47f-405d-b17b-2076be1fbf77 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c3bee08f-c47f-405d-b17b-2076be1fbf77 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:49 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c3bee08f-c47f-405d-b17b-2076be1fbf77 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:49 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c3bee08f-c47f-405d-b17b-2076be1fbf77 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c3bee08f-c47f-405d-b17b-2076be1fbf77 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c3bee08f-c47f-405d-b17b-2076be1fbf77 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:49 devstack sudo[97721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:10:49 devstack sudo[97721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:50 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dd1c9a10-635d-4c30-8113-58a2ab1caf2b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "cinder-65d79e25-0029-4a00-a2c9-12fb0ac4e896-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:50 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dd1c9a10-635d-4c30-8113-58a2ab1caf2b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-65d79e25-0029-4a00-a2c9-12fb0ac4e896-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:50 devstack sudo[97721]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c3bee08f-c47f-405d-b17b-2076be1fbf77 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.029s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:50 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-c3bee08f-c47f-405d-b17b-2076be1fbf77 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:10:50 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-c3bee08f-c47f-405d-b17b-2076be1fbf77 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Deleted volume successfully. Jul 08 01:10:50 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dd1c9a10-635d-4c30-8113-58a2ab1caf2b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "cinder-quobyte-65d79e25-0029-4a00-a2c9-12fb0ac4e896" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:50 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dd1c9a10-635d-4c30-8113-58a2ab1caf2b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-quobyte-65d79e25-0029-4a00-a2c9-12fb0ac4e896" acquired by "delete_volume" :: waited 0.027s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:50 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c3bee08f-c47f-405d-b17b-2076be1fbf77 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-b51aef0a-125b-404c-858c-a20ce6a024eb-delete_volume" released by "delete_volume" :: held 3.613s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:50 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43b9b86-e7f6-4898-a3b0-ed49562505ff]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dd1c9a10-635d-4c30-8113-58a2ab1caf2b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-65d79e25-0029-4a00-a2c9-12fb0ac4e896 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:50 devstack sudo[97729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-65d79e25-0029-4a00-a2c9-12fb0ac4e896 Jul 08 01:10:50 devstack sudo[97729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Flow 'volume_create_manager' (901b5354-f266-4b96-ade6-9a709f845cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb8248a-d89c-4121-9c38-ac8e9a831bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfb8248a-d89c-4121-9c38-ac8e9a831bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-342258070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c10d370c-617c-45a5-b40f-574e6f8ce6d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='478e723543c4428680591ae5fcb84c45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:51Z,use_quota=True,user_id='5b39e656272f4712bb6ef7e8b85141ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2430f4f8-a43a-492b-b57a-420bf8b05685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2430f4f8-a43a-492b-b57a-420bf8b05685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7719b745-1ad6-4adc-9fdc-1086b593ed39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7719b745-1ad6-4adc-9fdc-1086b593ed39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c10d370c-617c-45a5-b40f-574e6f8ce6d9', 'volume_name': 'volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1deb29e-4359-4746-a637-7cabf44aed36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1deb29e-4359-4746-a637-7cabf44aed36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a45c6d-bc28-4e89-b759-62f0390e62e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:51 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Volume c10d370c-617c-45a5-b40f-574e6f8ce6d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9', 'volume_size': 1} Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-342258070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c10d370c-617c-45a5-b40f-574e6f8ce6d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='478e723543c4428680591ae5fcb84c45',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:51Z,use_quota=True,user_id='5b39e656272f4712bb6ef7e8b85141ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Creating volume c10d370c-617c-45a5-b40f-574e6f8ce6d9 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:51 devstack sudo[97729]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:10:51 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dd1c9a10-635d-4c30-8113-58a2ab1caf2b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-65d79e25-0029-4a00-a2c9-12fb0ac4e896" returned: 0 in 0.993s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dd1c9a10-635d-4c30-8113-58a2ab1caf2b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-65d79e25-0029-4a00-a2c9-12fb0ac4e896 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:51 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9 1073741824 Jul 08 01:10:51 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:51 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-65d79e25-0029-4a00-a2c9-12fb0ac4e896 Jul 08 01:10:51 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:52 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dd1c9a10-635d-4c30-8113-58a2ab1caf2b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-65d79e25-0029-4a00-a2c9-12fb0ac4e896" returned: 0 in 0.740s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dd1c9a10-635d-4c30-8113-58a2ab1caf2b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-quobyte-65d79e25-0029-4a00-a2c9-12fb0ac4e896" released by "delete_volume" :: held 1.824s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-dd1c9a10-635d-4c30-8113-58a2ab1caf2b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Created reservations ['b33e3370-e7e2-4a23-a659-9f1661fda51f', 'f0badb14-9818-40ff-9eae-9515c0e2067e', '39e91926-5ad0-4fd3-acb7-3b00ccd8fc03', 'deba6012-365e-45fe-884d-fa8d4d81b1e5'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-dd1c9a10-635d-4c30-8113-58a2ab1caf2b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-dd1c9a10-635d-4c30-8113-58a2ab1caf2b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-dd1c9a10-635d-4c30-8113-58a2ab1caf2b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-dd1c9a10-635d-4c30-8113-58a2ab1caf2b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-dd1c9a10-635d-4c30-8113-58a2ab1caf2b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dd1c9a10-635d-4c30-8113-58a2ab1caf2b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:52 devstack sudo[97743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:10:52 devstack sudo[97743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:52 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9 1073741824" returned: 0 in 1.112s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6ccc7d89-d12d-4e59-b871-97439f83bb8f tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "cinder-be5a01bc-94db-473e-ba38-b1bc77fbf120-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6ccc7d89-d12d-4e59-b871-97439f83bb8f tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-be5a01bc-94db-473e-ba38-b1bc77fbf120-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:52 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9 Jul 08 01:10:52 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6ccc7d89-d12d-4e59-b871-97439f83bb8f tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "cinder-quobyte-be5a01bc-94db-473e-ba38-b1bc77fbf120" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6ccc7d89-d12d-4e59-b871-97439f83bb8f tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-quobyte-be5a01bc-94db-473e-ba38-b1bc77fbf120" acquired by "delete_volume" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[bafb5acf-3558-49df-af6e-83b738be54e5]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6ccc7d89-d12d-4e59-b871-97439f83bb8f tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-be5a01bc-94db-473e-ba38-b1bc77fbf120 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:52 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-be5a01bc-94db-473e-ba38-b1bc77fbf120 Jul 08 01:10:52 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Flow 'volume_create_manager' (27cfafd4-ee66-4c59-949c-6d93231532c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (862ad53c-2621-4873-a59c-47abfdceb03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (862ad53c-2621-4873-a59c-47abfdceb03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1766904664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa07a2b9-6712-4b8f-8bb6-c624a23c2e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74358083b7e94cf4803231933a7a83fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:53Z,use_quota=True,user_id='841718fcfe824a8d8799bca9bd608542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4b48bc-5308-4754-9aac-70b7dafb93ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4b48bc-5308-4754-9aac-70b7dafb93ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bafc595d-ffd2-4748-b6b1-260243ed6bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bafc595d-ffd2-4748-b6b1-260243ed6bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa07a2b9-6712-4b8f-8bb6-c624a23c2e65', 'volume_name': 'volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f09676-d5bd-4c9d-8ae1-f8b7a3640960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f09676-d5bd-4c9d-8ae1-f8b7a3640960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0597add0-fb61-49a2-a07b-930271f57cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:53 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Volume aa07a2b9-6712-4b8f-8bb6-c624a23c2e65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65', 'volume_size': 1} Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:53 devstack sudo[97743]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dd1c9a10-635d-4c30-8113-58a2ab1caf2b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.008s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-dd1c9a10-635d-4c30-8113-58a2ab1caf2b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:10:53 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-dd1c9a10-635d-4c30-8113-58a2ab1caf2b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Deleted volume successfully. Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dd1c9a10-635d-4c30-8113-58a2ab1caf2b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-65d79e25-0029-4a00-a2c9-12fb0ac4e896-delete_volume" released by "delete_volume" :: held 3.207s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:53 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9" returned: 0 in 0.877s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] <== create_volume: return (2081ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.426s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:10:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1766904664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa07a2b9-6712-4b8f-8bb6-c624a23c2e65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74358083b7e94cf4803231933a7a83fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:10:53Z,use_quota=True,user_id='841718fcfe824a8d8799bca9bd608542',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Creating volume aa07a2b9-6712-4b8f-8bb6-c624a23c2e65 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:10:53 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:53 devstack sudo[97751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65 1073741824 Jul 08 01:10:53 devstack sudo[97751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8a45c6d-bc28-4e89-b759-62f0390e62e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (349e96b6-005b-42ac-8521-9c03e00059a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:53 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Volume volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9 (c10d370c-617c-45a5-b40f-574e6f8ce6d9): created successfully Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (349e96b6-005b-42ac-8521-9c03e00059a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Flow 'volume_create_manager' (901b5354-f266-4b96-ade6-9a709f845cad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:53 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-38c1ef17-a048-4a4e-9fae-2bcb1be42997 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Created volume successfully. Jul 08 01:10:53 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6ccc7d89-d12d-4e59-b871-97439f83bb8f tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-be5a01bc-94db-473e-ba38-b1bc77fbf120" returned: 0 in 1.157s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6ccc7d89-d12d-4e59-b871-97439f83bb8f tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-be5a01bc-94db-473e-ba38-b1bc77fbf120 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:53 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-be5a01bc-94db-473e-ba38-b1bc77fbf120 Jul 08 01:10:53 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:54 devstack sudo[97751]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65 1073741824" returned: 0 in 1.420s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:54 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6ccc7d89-d12d-4e59-b871-97439f83bb8f tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-be5a01bc-94db-473e-ba38-b1bc77fbf120" returned: 0 in 1.091s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:54 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65 Jul 08 01:10:54 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6ccc7d89-d12d-4e59-b871-97439f83bb8f tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-quobyte-be5a01bc-94db-473e-ba38-b1bc77fbf120" released by "delete_volume" :: held 2.321s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-06cfcc28-c652-42a2-b1e1-6915cf7cd670 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:55 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-6ccc7d89-d12d-4e59-b871-97439f83bb8f tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Created reservations ['f3cac46d-a573-4797-88da-220f6bfdcb0a', '328f821e-c378-4ca3-8568-b4b6b50db01c', '63f3cd9a-9959-45e2-b842-06b814e997d7', '71a11bb4-238c-440d-83d3-7aebc569e44e'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:10:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6ccc7d89-d12d-4e59-b871-97439f83bb8f tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6ccc7d89-d12d-4e59-b871-97439f83bb8f tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6ccc7d89-d12d-4e59-b871-97439f83bb8f tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6ccc7d89-d12d-4e59-b871-97439f83bb8f tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6ccc7d89-d12d-4e59-b871-97439f83bb8f tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6ccc7d89-d12d-4e59-b871-97439f83bb8f tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:55 devstack sudo[97811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:10:55 devstack sudo[97811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:55 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65" returned: 0 in 0.767s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] <== create_volume: return (2257ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:10:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.259s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-06cfcc28-c652-42a2-b1e1-6915cf7cd670 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.696s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-06cfcc28-c652-42a2-b1e1-6915cf7cd670 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Creating offline snapshot e7ee0c84-5e60-479c-888d-c74523db0d6f of volume c10d370c-617c-45a5-b40f-574e6f8ce6d9 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:10:55 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0597add0-fb61-49a2-a07b-930271f57cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:55 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f3ea95-98a9-4991-a8f2-9da812023f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:10:55 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[a667a503-883a-4ea6-9f24-5076274a3131]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-06cfcc28-c652-42a2-b1e1-6915cf7cd670 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:55 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Volume volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65 (aa07a2b9-6712-4b8f-8bb6-c624a23c2e65): created successfully Jul 08 01:10:55 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85f3ea95-98a9-4991-a8f2-9da812023f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:10:55 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Flow 'volume_create_manager' (27cfafd4-ee66-4c59-949c-6d93231532c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:10:55 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-520d9187-d083-4e31-b40f-a72cf7e71b54 tempest-SnapshotMetadataTestJSON-898275415 None] Created volume successfully. Jul 08 01:10:55 devstack sudo[97834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9 Jul 08 01:10:55 devstack sudo[97834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:55 devstack sudo[97811]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6ccc7d89-d12d-4e59-b871-97439f83bb8f tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.798s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:55 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-6ccc7d89-d12d-4e59-b871-97439f83bb8f tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:10:55 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-6ccc7d89-d12d-4e59-b871-97439f83bb8f tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Deleted volume successfully. Jul 08 01:10:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9866a1cd-ad44-4477-b003-ff1a7c7f582b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "cinder-9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6ccc7d89-d12d-4e59-b871-97439f83bb8f tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-be5a01bc-94db-473e-ba38-b1bc77fbf120-delete_volume" released by "delete_volume" :: held 3.435s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9866a1cd-ad44-4477-b003-ff1a7c7f582b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9866a1cd-ad44-4477-b003-ff1a7c7f582b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "cinder-quobyte-9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9866a1cd-ad44-4477-b003-ff1a7c7f582b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-quobyte-9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04" acquired by "delete_volume" :: waited 0.022s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:56 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf64c1e-03ec-4d4a-adf0-a00ee27402df]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9866a1cd-ad44-4477-b003-ff1a7c7f582b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:56 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04 Jul 08 01:10:56 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-50bb8bdf-4cf3-40c3-be36-486165289384 tempest-SnapshotMetadataTestJSON-898275415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:56 devstack sudo[97834]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-06cfcc28-c652-42a2-b1e1-6915cf7cd670 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9" returned: 0 in 1.171s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-06cfcc28-c652-42a2-b1e1-6915cf7cd670 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.e7ee0c84-5e60-479c-888d-c74523db0d6f 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:56 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.e7ee0c84-5e60-479c-888d-c74523db0d6f 1G Jul 08 01:10:56 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:57 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9866a1cd-ad44-4477-b003-ff1a7c7f582b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04" returned: 0 in 1.093s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9866a1cd-ad44-4477-b003-ff1a7c7f582b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:57 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04 Jul 08 01:10:57 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:57 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-06cfcc28-c652-42a2-b1e1-6915cf7cd670 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.e7ee0c84-5e60-479c-888d-c74523db0d6f 1G" returned: 0 in 1.048s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-06cfcc28-c652-42a2-b1e1-6915cf7cd670 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.e7ee0c84-5e60-479c-888d-c74523db0d6f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:58 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.e7ee0c84-5e60-479c-888d-c74523db0d6f Jul 08 01:10:58 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:58 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9866a1cd-ad44-4477-b003-ff1a7c7f582b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04" returned: 0 in 0.761s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9866a1cd-ad44-4477-b003-ff1a7c7f582b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-quobyte-9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04" released by "delete_volume" :: held 1.927s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:58 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-9866a1cd-ad44-4477-b003-ff1a7c7f582b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Created reservations ['bff377f6-9f83-4a19-a282-6218152bd2dd', '1321da9d-f6c7-407c-95c4-d6aeb7b10e23', '2c373a73-cb36-4dca-aee1-3b2d3a0c1fd9', 'e11de87e-c987-42b6-b151-cfe207c47cbf'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:10:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9866a1cd-ad44-4477-b003-ff1a7c7f582b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:10:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9866a1cd-ad44-4477-b003-ff1a7c7f582b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:10:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9866a1cd-ad44-4477-b003-ff1a7c7f582b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:10:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9866a1cd-ad44-4477-b003-ff1a7c7f582b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:10:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9866a1cd-ad44-4477-b003-ff1a7c7f582b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:10:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9866a1cd-ad44-4477-b003-ff1a7c7f582b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:58 devstack sudo[97858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:10:58 devstack sudo[97858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0d20f684-003f-4d08-894a-5985485c547d tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "cinder-fa078407-931e-4aef-84cd-ec08fe15ff94-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0d20f684-003f-4d08-894a-5985485c547d tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-fa078407-931e-4aef-84cd-ec08fe15ff94-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-651added-c5fd-4df8-8961-9457cf42ecf5 tempest-VolumesActionsTest-1485080785 None] Acquiring lock "cinder-99dce23f-6c80-49ed-858d-bdebbb19cfa2" by "attach_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-651added-c5fd-4df8-8961-9457cf42ecf5 tempest-VolumesActionsTest-1485080785 None] Lock "cinder-99dce23f-6c80-49ed-858d-bdebbb19cfa2" acquired by "attach_volume" :: waited 0.052s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0d20f684-003f-4d08-894a-5985485c547d tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "cinder-quobyte-fa078407-931e-4aef-84cd-ec08fe15ff94" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0d20f684-003f-4d08-894a-5985485c547d tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-quobyte-fa078407-931e-4aef-84cd-ec08fe15ff94" acquired by "delete_volume" :: waited 0.033s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:58 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b694eb-a7dd-4b47-a8fa-423267e99fd4]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:10:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0d20f684-003f-4d08-894a-5985485c547d tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fa078407-931e-4aef-84cd-ec08fe15ff94 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:58 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-651added-c5fd-4df8-8961-9457cf42ecf5 tempest-VolumesActionsTest-1485080785 None] Attaching volume 99dce23f-6c80-49ed-858d-bdebbb19cfa2 to instance 8c106345-a677-4da4-9bab-3e17fe71914d at mountpoint /dev/vdb on host None. Jul 08 01:10:58 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-651added-c5fd-4df8-8961-9457cf42ecf5 tempest-VolumesActionsTest-1485080785 None] Attach volume completed successfully. Jul 08 01:10:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-651added-c5fd-4df8-8961-9457cf42ecf5 tempest-VolumesActionsTest-1485080785 None] Lock "cinder-99dce23f-6c80-49ed-858d-bdebbb19cfa2" released by "attach_volume" :: held 0.210s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:58 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fa078407-931e-4aef-84cd-ec08fe15ff94 Jul 08 01:10:58 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-bfee1918-4e8e-450b-b75f-9275ec15cf7f tempest-VolumesActionsTest-1485080785 None] Acquiring lock "cinder-99dce23f-6c80-49ed-858d-bdebbb19cfa2-detach_volume" by "detach_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:10:59 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-06cfcc28-c652-42a2-b1e1-6915cf7cd670 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.e7ee0c84-5e60-479c-888d-c74523db0d6f" returned: 0 in 1.331s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:59 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-06cfcc28-c652-42a2-b1e1-6915cf7cd670 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.e7ee0c84-5e60-479c-888d-c74523db0d6f is being set with open permissions: ugo+rw Jul 08 01:10:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-06cfcc28-c652-42a2-b1e1-6915cf7cd670 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.e7ee0c84-5e60-479c-888d-c74523db0d6f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:10:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-bfee1918-4e8e-450b-b75f-9275ec15cf7f tempest-VolumesActionsTest-1485080785 None] Lock "cinder-99dce23f-6c80-49ed-858d-bdebbb19cfa2-detach_volume" acquired by "detach_volume" :: waited 0.074s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:10:59 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-bfee1918-4e8e-450b-b75f-9275ec15cf7f tempest-VolumesActionsTest-1485080785 None] Detaching volume 99dce23f-6c80-49ed-858d-bdebbb19cfa2 from instance 8c106345-a677-4da4-9bab-3e17fe71914d. Jul 08 01:10:59 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.e7ee0c84-5e60-479c-888d-c74523db0d6f Jul 08 01:10:59 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:10:59 devstack sudo[97858]: pam_unix(sudo:session): session closed for user root Jul 08 01:10:59 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-bfee1918-4e8e-450b-b75f-9275ec15cf7f tempest-VolumesActionsTest-1485080785 None] Detach volume completed successfully. Jul 08 01:10:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9866a1cd-ad44-4477-b003-ff1a7c7f582b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.180s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:10:59 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-9866a1cd-ad44-4477-b003-ff1a7c7f582b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:10:59 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-9866a1cd-ad44-4477-b003-ff1a7c7f582b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Deleted volume successfully. Jul 08 01:10:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-bfee1918-4e8e-450b-b75f-9275ec15cf7f tempest-VolumesActionsTest-1485080785 None] Lock "cinder-99dce23f-6c80-49ed-858d-bdebbb19cfa2-detach_volume" released by "detach_volume" :: held 0.175s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:10:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9866a1cd-ad44-4477-b003-ff1a7c7f582b tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-9f70cb2b-2f3a-4d6a-84b7-de8cf8cb0c04-delete_volume" released by "delete_volume" :: held 3.519s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0d20f684-003f-4d08-894a-5985485c547d tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fa078407-931e-4aef-84cd-ec08fe15ff94" returned: 0 in 1.411s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0d20f684-003f-4d08-894a-5985485c547d tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fa078407-931e-4aef-84cd-ec08fe15ff94 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:00 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:00 devstack sudo[97872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fa078407-931e-4aef-84cd-ec08fe15ff94 Jul 08 01:11:00 devstack sudo[97872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:00 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-06cfcc28-c652-42a2-b1e1-6915cf7cd670 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.e7ee0c84-5e60-479c-888d-c74523db0d6f" returned: 0 in 0.865s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-06cfcc28-c652-42a2-b1e1-6915cf7cd670 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:00 devstack sudo[97875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.info Jul 08 01:11:00 devstack sudo[97875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:00 devstack sudo[97872]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0d20f684-003f-4d08-894a-5985485c547d tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fa078407-931e-4aef-84cd-ec08fe15ff94" returned: 0 in 0.812s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:00 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0d20f684-003f-4d08-894a-5985485c547d tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-quobyte-fa078407-931e-4aef-84cd-ec08fe15ff94" released by "delete_volume" :: held 2.281s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:00 devstack sudo[97875]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-06cfcc28-c652-42a2-b1e1-6915cf7cd670 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.info" returned: 0 in 0.699s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:00 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-06cfcc28-c652-42a2-b1e1-6915cf7cd670 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.info is being set with open permissions: ugo+rw Jul 08 01:11:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-06cfcc28-c652-42a2-b1e1-6915cf7cd670 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:00 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.info Jul 08 01:11:00 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:00 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-0d20f684-003f-4d08-894a-5985485c547d tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Created reservations ['50aa241e-9898-40ae-83f7-9d5e5479f3b4', 'e6d678f3-8e6d-4d18-9f5d-87aa832b4a8f', '75296589-ef43-4a4e-b921-fbb999bc92ae', 'a7d28d60-b116-495d-811a-2b233fd549d2'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:11:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0d20f684-003f-4d08-894a-5985485c547d tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0d20f684-003f-4d08-894a-5985485c547d tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0d20f684-003f-4d08-894a-5985485c547d tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0d20f684-003f-4d08-894a-5985485c547d tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0d20f684-003f-4d08-894a-5985485c547d tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0d20f684-003f-4d08-894a-5985485c547d tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:01 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:11:01 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:01 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-06cfcc28-c652-42a2-b1e1-6915cf7cd670 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.info" returned: 0 in 0.703s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-06cfcc28-c652-42a2-b1e1-6915cf7cd670 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.943s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-50bb8bdf-4cf3-40c3-be36-486165289384 tempest-SnapshotMetadataTestJSON-898275415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.129s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-50bb8bdf-4cf3-40c3-be36-486165289384 tempest-SnapshotMetadataTestJSON-898275415 None] Creating offline snapshot 7d13843d-d226-46f6-993a-2521c6437083 of volume aa07a2b9-6712-4b8f-8bb6-c624a23c2e65 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:11:01 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-06cfcc28-c652-42a2-b1e1-6915cf7cd670 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Create snapshot completed successfully Jul 08 01:11:01 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e139712-9d13-4f02-8f39-cdbdf113fb6e]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50bb8bdf-4cf3-40c3-be36-486165289384 tempest-SnapshotMetadataTestJSON-898275415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:01 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0d20f684-003f-4d08-894a-5985485c547d tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.867s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:01 devstack sudo[97890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65 Jul 08 01:11:01 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-0d20f684-003f-4d08-894a-5985485c547d tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:11:01 devstack sudo[97890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:01 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2244d0c0-6607-49a9-a1f8-ffe64ac19505 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "cinder-7e956724-26c1-4d73-a584-c507a871e2f3-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:01 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-0d20f684-003f-4d08-894a-5985485c547d tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Deleted volume successfully. Jul 08 01:11:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2244d0c0-6607-49a9-a1f8-ffe64ac19505 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-7e956724-26c1-4d73-a584-c507a871e2f3-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0d20f684-003f-4d08-894a-5985485c547d tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-fa078407-931e-4aef-84cd-ec08fe15ff94-delete_volume" released by "delete_volume" :: held 3.625s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2244d0c0-6607-49a9-a1f8-ffe64ac19505 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "cinder-quobyte-7e956724-26c1-4d73-a584-c507a871e2f3" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2244d0c0-6607-49a9-a1f8-ffe64ac19505 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-quobyte-7e956724-26c1-4d73-a584-c507a871e2f3" acquired by "delete_volume" :: waited 0.032s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:02 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e338ec-f355-4dc6-8178-e86f4ec621b4]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2244d0c0-6607-49a9-a1f8-ffe64ac19505 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7e956724-26c1-4d73-a584-c507a871e2f3 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:02 devstack sudo[97906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7e956724-26c1-4d73-a584-c507a871e2f3 Jul 08 01:11:02 devstack sudo[97906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:03 devstack sudo[97890]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50bb8bdf-4cf3-40c3-be36-486165289384 tempest-SnapshotMetadataTestJSON-898275415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65" returned: 0 in 1.510s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50bb8bdf-4cf3-40c3-be36-486165289384 tempest-SnapshotMetadataTestJSON-898275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.7d13843d-d226-46f6-993a-2521c6437083 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:03 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.7d13843d-d226-46f6-993a-2521c6437083 1G Jul 08 01:11:03 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dedd89eb-6ff3-42d8-a2cc-b08ed8ca5204 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Acquiring lock "cinder-e7ee0c84-5e60-479c-888d-c74523db0d6f-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dedd89eb-6ff3-42d8-a2cc-b08ed8ca5204 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Lock "cinder-e7ee0c84-5e60-479c-888d-c74523db0d6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dedd89eb-6ff3-42d8-a2cc-b08ed8ca5204 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Acquiring lock "cinder-quobyte-c10d370c-617c-45a5-b40f-574e6f8ce6d9" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dedd89eb-6ff3-42d8-a2cc-b08ed8ca5204 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Lock "cinder-quobyte-c10d370c-617c-45a5-b40f-574e6f8ce6d9" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dedd89eb-6ff3-42d8-a2cc-b08ed8ca5204 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Acquiring lock "cinder-quobyte-e7ee0c84-5e60-479c-888d-c74523db0d6f" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:03 devstack sudo[97906]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dedd89eb-6ff3-42d8-a2cc-b08ed8ca5204 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Lock "cinder-quobyte-e7ee0c84-5e60-479c-888d-c74523db0d6f" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:03 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-dedd89eb-6ff3-42d8-a2cc-b08ed8ca5204 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Deleting offline snapshot e7ee0c84-5e60-479c-888d-c74523db0d6f of volume c10d370c-617c-45a5-b40f-574e6f8ce6d9 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:11:03 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-dedd89eb-6ff3-42d8-a2cc-b08ed8ca5204 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] snapshot_file for this snap is: volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.e7ee0c84-5e60-479c-888d-c74523db0d6f {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:11:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2244d0c0-6607-49a9-a1f8-ffe64ac19505 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7e956724-26c1-4d73-a584-c507a871e2f3" returned: 0 in 1.309s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2244d0c0-6607-49a9-a1f8-ffe64ac19505 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7e956724-26c1-4d73-a584-c507a871e2f3 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:03 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0445cab-1cff-4f0e-b6e5-df917301b45f]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dedd89eb-6ff3-42d8-a2cc-b08ed8ca5204 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.e7ee0c84-5e60-479c-888d-c74523db0d6f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:03 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7e956724-26c1-4d73-a584-c507a871e2f3 Jul 08 01:11:03 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:03 devstack sudo[97923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.e7ee0c84-5e60-479c-888d-c74523db0d6f Jul 08 01:11:03 devstack sudo[97923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:04 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50bb8bdf-4cf3-40c3-be36-486165289384 tempest-SnapshotMetadataTestJSON-898275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.7d13843d-d226-46f6-993a-2521c6437083 1G" returned: 0 in 1.061s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50bb8bdf-4cf3-40c3-be36-486165289384 tempest-SnapshotMetadataTestJSON-898275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.7d13843d-d226-46f6-993a-2521c6437083 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:04 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.7d13843d-d226-46f6-993a-2521c6437083 Jul 08 01:11:04 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:04 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2244d0c0-6607-49a9-a1f8-ffe64ac19505 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-7e956724-26c1-4d73-a584-c507a871e2f3" returned: 0 in 0.994s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:04 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2244d0c0-6607-49a9-a1f8-ffe64ac19505 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-quobyte-7e956724-26c1-4d73-a584-c507a871e2f3" released by "delete_volume" :: held 2.388s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:04 devstack sudo[97923]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dedd89eb-6ff3-42d8-a2cc-b08ed8ca5204 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.e7ee0c84-5e60-479c-888d-c74523db0d6f" returned: 0 in 1.036s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:04 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-dedd89eb-6ff3-42d8-a2cc-b08ed8ca5204 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:11:04 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[8875b62e-1d00-47f8-a4ba-2ddd7b35ac39]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dedd89eb-6ff3-42d8-a2cc-b08ed8ca5204 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:04 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-2244d0c0-6607-49a9-a1f8-ffe64ac19505 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Created reservations ['d82ae6e1-9b43-4d75-a251-62bcbf538ec0', '43c829f4-9eef-4b37-a296-042d07b62663', '770143d8-8e4f-4f68-b742-fbdce4b07d92', '48ba4157-4b24-4507-9673-ddae2cf83846'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:11:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2244d0c0-6607-49a9-a1f8-ffe64ac19505 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2244d0c0-6607-49a9-a1f8-ffe64ac19505 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:04 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2244d0c0-6607-49a9-a1f8-ffe64ac19505 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:04 devstack sudo[97936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9 Jul 08 01:11:04 devstack sudo[97936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:04 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2244d0c0-6607-49a9-a1f8-ffe64ac19505 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2244d0c0-6607-49a9-a1f8-ffe64ac19505 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2244d0c0-6607-49a9-a1f8-ffe64ac19505 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:04 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:11:04 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:05 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50bb8bdf-4cf3-40c3-be36-486165289384 tempest-SnapshotMetadataTestJSON-898275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.7d13843d-d226-46f6-993a-2521c6437083" returned: 0 in 0.863s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:05 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-50bb8bdf-4cf3-40c3-be36-486165289384 tempest-SnapshotMetadataTestJSON-898275415 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.7d13843d-d226-46f6-993a-2521c6437083 is being set with open permissions: ugo+rw Jul 08 01:11:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50bb8bdf-4cf3-40c3-be36-486165289384 tempest-SnapshotMetadataTestJSON-898275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.7d13843d-d226-46f6-993a-2521c6437083 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:05 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.7d13843d-d226-46f6-993a-2521c6437083 Jul 08 01:11:05 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:05 devstack sudo[97936]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dedd89eb-6ff3-42d8-a2cc-b08ed8ca5204 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9" returned: 0 in 0.872s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dedd89eb-6ff3-42d8-a2cc-b08ed8ca5204 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.e7ee0c84-5e60-479c-888d-c74523db0d6f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:05 devstack sudo[97948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.e7ee0c84-5e60-479c-888d-c74523db0d6f Jul 08 01:11:05 devstack sudo[97948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:05 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2244d0c0-6607-49a9-a1f8-ffe64ac19505 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.023s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:05 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-2244d0c0-6607-49a9-a1f8-ffe64ac19505 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:11:05 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-2244d0c0-6607-49a9-a1f8-ffe64ac19505 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Deleted volume successfully. Jul 08 01:11:05 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:05 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2244d0c0-6607-49a9-a1f8-ffe64ac19505 tempest-CreateVolumesFromSourceVolumeTest-983278692 None] Lock "cinder-7e956724-26c1-4d73-a584-c507a871e2f3-delete_volume" released by "delete_volume" :: held 3.822s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50bb8bdf-4cf3-40c3-be36-486165289384 tempest-SnapshotMetadataTestJSON-898275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.7d13843d-d226-46f6-993a-2521c6437083" returned: 0 in 0.711s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50bb8bdf-4cf3-40c3-be36-486165289384 tempest-SnapshotMetadataTestJSON-898275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:05 devstack sudo[97952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.info Jul 08 01:11:05 devstack sudo[97952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:06 devstack sudo[97948]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dedd89eb-6ff3-42d8-a2cc-b08ed8ca5204 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.e7ee0c84-5e60-479c-888d-c74523db0d6f" returned: 0 in 0.898s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dedd89eb-6ff3-42d8-a2cc-b08ed8ca5204 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.e7ee0c84-5e60-479c-888d-c74523db0d6f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:06 devstack sudo[97958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.e7ee0c84-5e60-479c-888d-c74523db0d6f Jul 08 01:11:06 devstack sudo[97958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:06 devstack sudo[97952]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50bb8bdf-4cf3-40c3-be36-486165289384 tempest-SnapshotMetadataTestJSON-898275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.info" returned: 0 in 0.841s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:06 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-50bb8bdf-4cf3-40c3-be36-486165289384 tempest-SnapshotMetadataTestJSON-898275415 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.info is being set with open permissions: ugo+rw Jul 08 01:11:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50bb8bdf-4cf3-40c3-be36-486165289384 tempest-SnapshotMetadataTestJSON-898275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:06 devstack sudo[97961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.info Jul 08 01:11:06 devstack sudo[97961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:07 devstack sudo[97958]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dedd89eb-6ff3-42d8-a2cc-b08ed8ca5204 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9.e7ee0c84-5e60-479c-888d-c74523db0d6f" returned: 0 in 0.832s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dedd89eb-6ff3-42d8-a2cc-b08ed8ca5204 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Lock "cinder-quobyte-e7ee0c84-5e60-479c-888d-c74523db0d6f" released by "_delete_snapshot" :: held 3.812s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dedd89eb-6ff3-42d8-a2cc-b08ed8ca5204 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Lock "cinder-quobyte-c10d370c-617c-45a5-b40f-574e6f8ce6d9" released by "delete_snapshot" :: held 3.870s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:07 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-dedd89eb-6ff3-42d8-a2cc-b08ed8ca5204 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Created reservations ['a569819c-0587-4f85-a1bc-3c9bc4806517', '18d22007-f959-415b-a11f-a5928bc54c23', '1a77f871-276b-4f5f-ba80-4975d84b07ed', '8b5e518c-653f-4788-8a1e-d45191169e3b'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:11:07 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-dedd89eb-6ff3-42d8-a2cc-b08ed8ca5204 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Delete snapshot completed successfully. Jul 08 01:11:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dedd89eb-6ff3-42d8-a2cc-b08ed8ca5204 tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Lock "cinder-e7ee0c84-5e60-479c-888d-c74523db0d6f-delete_snapshot" released by "delete_snapshot" :: held 4.048s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:07 devstack sudo[97961]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-50bb8bdf-4cf3-40c3-be36-486165289384 tempest-SnapshotMetadataTestJSON-898275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.info" returned: 0 in 0.793s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-50bb8bdf-4cf3-40c3-be36-486165289384 tempest-SnapshotMetadataTestJSON-898275415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.925s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:07 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-50bb8bdf-4cf3-40c3-be36-486165289384 tempest-SnapshotMetadataTestJSON-898275415 None] Create snapshot completed successfully Jul 08 01:11:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3ffa69ce-f13a-4e97-847d-5d99d678b7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Acquiring lock "cinder-c10d370c-617c-45a5-b40f-574e6f8ce6d9-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3ffa69ce-f13a-4e97-847d-5d99d678b7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Lock "cinder-c10d370c-617c-45a5-b40f-574e6f8ce6d9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3ffa69ce-f13a-4e97-847d-5d99d678b7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Acquiring lock "cinder-quobyte-c10d370c-617c-45a5-b40f-574e6f8ce6d9" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3ffa69ce-f13a-4e97-847d-5d99d678b7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Lock "cinder-quobyte-c10d370c-617c-45a5-b40f-574e6f8ce6d9" acquired by "delete_volume" :: waited 0.015s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:07 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65c11fa-aa1e-4dd2-abf3-ffaaf621041d]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3ffa69ce-f13a-4e97-847d-5d99d678b7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:07 devstack sudo[97965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9 Jul 08 01:11:07 devstack sudo[97965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:08 devstack sudo[97965]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3ffa69ce-f13a-4e97-847d-5d99d678b7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9" returned: 0 in 0.962s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3ffa69ce-f13a-4e97-847d-5d99d678b7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:08 devstack sudo[97970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9 Jul 08 01:11:08 devstack sudo[97970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Flow 'volume_create_manager' (f2dd9f72-e7bc-4aa2-959a-67ee51eb4d0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f9e76e-f9ff-4ec3-92f4-25d276f9c8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23f9e76e-f9ff-4ec3-92f4-25d276f9c8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1269498481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ac1be2-3e8d-4ed2-92b9-35bde483b59f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd9107230974d8aa8c81e77db570e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:09Z,use_quota=True,user_id='436f3897aa154b26b592eb0ca372951e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02156b15-a177-4638-89f6-e5ee030c91f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02156b15-a177-4638-89f6-e5ee030c91f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77deec2c-b5bd-426d-be1e-a64a173ee128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77deec2c-b5bd-426d-be1e-a64a173ee128) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55ac1be2-3e8d-4ed2-92b9-35bde483b59f', 'volume_name': 'volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb253b2-ba93-4389-a3ed-87eaadd78a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eeb253b2-ba93-4389-a3ed-87eaadd78a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4df4cc25-25d2-41d0-9eb5-b445f52a1b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:09 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Volume 55ac1be2-3e8d-4ed2-92b9-35bde483b59f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f', 'volume_size': 1} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1269498481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55ac1be2-3e8d-4ed2-92b9-35bde483b59f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd9107230974d8aa8c81e77db570e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:09Z,use_quota=True,user_id='436f3897aa154b26b592eb0ca372951e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Creating volume 55ac1be2-3e8d-4ed2-92b9-35bde483b59f {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:11:09 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:09 devstack sudo[97972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f 1073741824 Jul 08 01:11:09 devstack sudo[97972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2573e648-1382-4651-91ca-3a060598b3c4 tempest-SnapshotMetadataTestJSON-898275415 None] Acquiring lock "cinder-7d13843d-d226-46f6-993a-2521c6437083-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2573e648-1382-4651-91ca-3a060598b3c4 tempest-SnapshotMetadataTestJSON-898275415 None] Lock "cinder-7d13843d-d226-46f6-993a-2521c6437083-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2573e648-1382-4651-91ca-3a060598b3c4 tempest-SnapshotMetadataTestJSON-898275415 None] Acquiring lock "cinder-quobyte-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2573e648-1382-4651-91ca-3a060598b3c4 tempest-SnapshotMetadataTestJSON-898275415 None] Lock "cinder-quobyte-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2573e648-1382-4651-91ca-3a060598b3c4 tempest-SnapshotMetadataTestJSON-898275415 None] Acquiring lock "cinder-quobyte-7d13843d-d226-46f6-993a-2521c6437083" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2573e648-1382-4651-91ca-3a060598b3c4 tempest-SnapshotMetadataTestJSON-898275415 None] Lock "cinder-quobyte-7d13843d-d226-46f6-993a-2521c6437083" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-2573e648-1382-4651-91ca-3a060598b3c4 tempest-SnapshotMetadataTestJSON-898275415 None] Deleting offline snapshot 7d13843d-d226-46f6-993a-2521c6437083 of volume aa07a2b9-6712-4b8f-8bb6-c624a23c2e65 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-2573e648-1382-4651-91ca-3a060598b3c4 tempest-SnapshotMetadataTestJSON-898275415 None] snapshot_file for this snap is: volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.7d13843d-d226-46f6-993a-2521c6437083 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[22eaa6cb-1785-49b0-9bb4-c48a55c14f23]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2573e648-1382-4651-91ca-3a060598b3c4 tempest-SnapshotMetadataTestJSON-898275415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.7d13843d-d226-46f6-993a-2521c6437083 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:09 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.7d13843d-d226-46f6-993a-2521c6437083 Jul 08 01:11:09 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:09 devstack sudo[97970]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3ffa69ce-f13a-4e97-847d-5d99d678b7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c10d370c-617c-45a5-b40f-574e6f8ce6d9" returned: 0 in 0.880s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3ffa69ce-f13a-4e97-847d-5d99d678b7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Lock "cinder-quobyte-c10d370c-617c-45a5-b40f-574e6f8ce6d9" released by "delete_volume" :: held 1.922s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-3ffa69ce-f13a-4e97-847d-5d99d678b7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Created reservations ['8297fbad-ea03-43b2-9c58-e20ac09f3f28', 'd16fcb10-a873-4e38-a3e7-7d0576a4c939', '8ac41c3d-c32c-4e5b-8961-f782cc3c9614', '8d5f7e95-ab03-46ca-b4f0-170a607803f1'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3ffa69ce-f13a-4e97-847d-5d99d678b7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3ffa69ce-f13a-4e97-847d-5d99d678b7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3ffa69ce-f13a-4e97-847d-5d99d678b7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3ffa69ce-f13a-4e97-847d-5d99d678b7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3ffa69ce-f13a-4e97-847d-5d99d678b7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3ffa69ce-f13a-4e97-847d-5d99d678b7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:09 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:11:09 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:10 devstack sudo[97972]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f 1073741824" returned: 0 in 1.290s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:10 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2573e648-1382-4651-91ca-3a060598b3c4 tempest-SnapshotMetadataTestJSON-898275415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.7d13843d-d226-46f6-993a-2521c6437083" returned: 0 in 1.154s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:10 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-2573e648-1382-4651-91ca-3a060598b3c4 tempest-SnapshotMetadataTestJSON-898275415 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:11:10 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[903c0dce-7ec3-4912-be35-9a76fcdece88]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2573e648-1382-4651-91ca-3a060598b3c4 tempest-SnapshotMetadataTestJSON-898275415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:10 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f Jul 08 01:11:10 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:10 devstack sudo[97991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65 Jul 08 01:11:10 devstack sudo[97991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:10 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3ffa69ce-f13a-4e97-847d-5d99d678b7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.014s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:10 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-3ffa69ce-f13a-4e97-847d-5d99d678b7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:11:10 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-3ffa69ce-f13a-4e97-847d-5d99d678b7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Deleted volume successfully. Jul 08 01:11:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3ffa69ce-f13a-4e97-847d-5d99d678b7ba tempest-VolumeSnapshotQuotasNegativeTestJSON-534252646 None] Lock "cinder-c10d370c-617c-45a5-b40f-574e6f8ce6d9-delete_volume" released by "delete_volume" :: held 3.187s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:11 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f" returned: 0 in 0.898s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] <== create_volume: return (2352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:11:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.356s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4df4cc25-25d2-41d0-9eb5-b445f52a1b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c22e565-d49e-45cd-99e3-2bfae5fb7695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:11 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Volume volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f (55ac1be2-3e8d-4ed2-92b9-35bde483b59f): created successfully Jul 08 01:11:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c22e565-d49e-45cd-99e3-2bfae5fb7695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Flow 'volume_create_manager' (f2dd9f72-e7bc-4aa2-959a-67ee51eb4d0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:11 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-2df237ff-8151-4c26-b649-feb3743b5fcf tempest-VolumeDependencyTests-1472792227 None] Created volume successfully. Jul 08 01:11:11 devstack sudo[97991]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2573e648-1382-4651-91ca-3a060598b3c4 tempest-SnapshotMetadataTestJSON-898275415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65" returned: 0 in 1.033s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2573e648-1382-4651-91ca-3a060598b3c4 tempest-SnapshotMetadataTestJSON-898275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.7d13843d-d226-46f6-993a-2521c6437083 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:11 devstack sudo[98000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.7d13843d-d226-46f6-993a-2521c6437083 Jul 08 01:11:11 devstack sudo[98000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f27da3cb-9837-444c-8641-52d271871ce4 tempest-VolumeDependencyTests-1472792227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f27da3cb-9837-444c-8641-52d271871ce4 tempest-VolumeDependencyTests-1472792227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f27da3cb-9837-444c-8641-52d271871ce4 tempest-VolumeDependencyTests-1472792227 None] Creating offline snapshot f5f8045a-bd55-4004-86f9-d2ab83ed5305 of volume 55ac1be2-3e8d-4ed2-92b9-35bde483b59f {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:11:12 devstack sudo[98000]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2573e648-1382-4651-91ca-3a060598b3c4 tempest-SnapshotMetadataTestJSON-898275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.7d13843d-d226-46f6-993a-2521c6437083" returned: 0 in 0.910s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2573e648-1382-4651-91ca-3a060598b3c4 tempest-SnapshotMetadataTestJSON-898275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.7d13843d-d226-46f6-993a-2521c6437083 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:12 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e485d1-005d-4352-821a-f4d7e62fb9b2]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f27da3cb-9837-444c-8641-52d271871ce4 tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:12 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.7d13843d-d226-46f6-993a-2521c6437083 Jul 08 01:11:12 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:12 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f Jul 08 01:11:12 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:13 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2573e648-1382-4651-91ca-3a060598b3c4 tempest-SnapshotMetadataTestJSON-898275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65.7d13843d-d226-46f6-993a-2521c6437083" returned: 0 in 0.943s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2573e648-1382-4651-91ca-3a060598b3c4 tempest-SnapshotMetadataTestJSON-898275415 None] Lock "cinder-quobyte-7d13843d-d226-46f6-993a-2521c6437083" released by "_delete_snapshot" :: held 4.195s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2573e648-1382-4651-91ca-3a060598b3c4 tempest-SnapshotMetadataTestJSON-898275415 None] Lock "cinder-quobyte-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65" released by "delete_snapshot" :: held 4.231s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:13 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-2573e648-1382-4651-91ca-3a060598b3c4 tempest-SnapshotMetadataTestJSON-898275415 None] Created reservations ['642eb28a-b65d-4bf0-9921-8b52f0f4c4e2', 'ef4523ad-97c3-422e-ab3e-321f9db7319b', '6bc99ba5-67b1-4cd6-bff9-9f506a31410f', 'c1e00bcf-1daf-40da-bcc0-ba0015376c77'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:11:13 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-2573e648-1382-4651-91ca-3a060598b3c4 tempest-SnapshotMetadataTestJSON-898275415 None] Delete snapshot completed successfully. Jul 08 01:11:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2573e648-1382-4651-91ca-3a060598b3c4 tempest-SnapshotMetadataTestJSON-898275415 None] Lock "cinder-7d13843d-d226-46f6-993a-2521c6437083-delete_snapshot" released by "delete_snapshot" :: held 4.434s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:13 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f27da3cb-9837-444c-8641-52d271871ce4 tempest-VolumeDependencyTests-1472792227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f" returned: 0 in 1.230s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f27da3cb-9837-444c-8641-52d271871ce4 tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:13 devstack sudo[98050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305 1G Jul 08 01:11:13 devstack sudo[98050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:14 devstack sudo[98050]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f27da3cb-9837-444c-8641-52d271871ce4 tempest-VolumeDependencyTests-1472792227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305 1G" returned: 0 in 0.880s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f27da3cb-9837-444c-8641-52d271871ce4 tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:14 devstack sudo[98056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305 Jul 08 01:11:14 devstack sudo[98056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66262dc6-0e73-4663-97fc-b92c8f5b8977 tempest-SnapshotMetadataTestJSON-898275415 None] Acquiring lock "cinder-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66262dc6-0e73-4663-97fc-b92c8f5b8977 tempest-SnapshotMetadataTestJSON-898275415 None] Lock "cinder-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66262dc6-0e73-4663-97fc-b92c8f5b8977 tempest-SnapshotMetadataTestJSON-898275415 None] Acquiring lock "cinder-quobyte-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66262dc6-0e73-4663-97fc-b92c8f5b8977 tempest-SnapshotMetadataTestJSON-898275415 None] Lock "cinder-quobyte-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65" acquired by "delete_volume" :: waited 0.014s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:14 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c71a73-89fb-4620-ae26-2d1261e21fdf]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66262dc6-0e73-4663-97fc-b92c8f5b8977 tempest-SnapshotMetadataTestJSON-898275415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:14 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65 Jul 08 01:11:14 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:15 devstack sudo[98056]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f27da3cb-9837-444c-8641-52d271871ce4 tempest-VolumeDependencyTests-1472792227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305" returned: 0 in 1.022s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:15 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-f27da3cb-9837-444c-8641-52d271871ce4 tempest-VolumeDependencyTests-1472792227 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305 is being set with open permissions: ugo+rw Jul 08 01:11:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f27da3cb-9837-444c-8641-52d271871ce4 tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:15 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305 Jul 08 01:11:15 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:15 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66262dc6-0e73-4663-97fc-b92c8f5b8977 tempest-SnapshotMetadataTestJSON-898275415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65" returned: 0 in 0.951s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66262dc6-0e73-4663-97fc-b92c8f5b8977 tempest-SnapshotMetadataTestJSON-898275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:15 devstack sudo[98071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65 Jul 08 01:11:15 devstack sudo[98071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:16 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f27da3cb-9837-444c-8641-52d271871ce4 tempest-VolumeDependencyTests-1472792227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305" returned: 0 in 1.245s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:17 devstack sudo[98071]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f27da3cb-9837-444c-8641-52d271871ce4 tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66262dc6-0e73-4663-97fc-b92c8f5b8977 tempest-SnapshotMetadataTestJSON-898275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65" returned: 0 in 1.221s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:17 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.info Jul 08 01:11:17 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66262dc6-0e73-4663-97fc-b92c8f5b8977 tempest-SnapshotMetadataTestJSON-898275415 None] Lock "cinder-quobyte-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65" released by "delete_volume" :: held 2.273s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-66262dc6-0e73-4663-97fc-b92c8f5b8977 tempest-SnapshotMetadataTestJSON-898275415 None] Created reservations ['3c9cce23-2724-4b1a-b86f-cd4d4645c7b7', 'd5581643-7503-4b43-9f4e-f5d0187f4532', '48e6f993-f178-44ff-a2c5-7c28f82622b5', '8ce5d28d-079a-4716-bdb4-af68b24db42e'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-66262dc6-0e73-4663-97fc-b92c8f5b8977 tempest-SnapshotMetadataTestJSON-898275415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-66262dc6-0e73-4663-97fc-b92c8f5b8977 tempest-SnapshotMetadataTestJSON-898275415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-66262dc6-0e73-4663-97fc-b92c8f5b8977 tempest-SnapshotMetadataTestJSON-898275415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-66262dc6-0e73-4663-97fc-b92c8f5b8977 tempest-SnapshotMetadataTestJSON-898275415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-66262dc6-0e73-4663-97fc-b92c8f5b8977 tempest-SnapshotMetadataTestJSON-898275415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66262dc6-0e73-4663-97fc-b92c8f5b8977 tempest-SnapshotMetadataTestJSON-898275415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:17 devstack sudo[98077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:11:17 devstack sudo[98077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Flow 'volume_create_manager' (cba6c311-ffad-4c3f-9a6a-d6442eec2d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32db2925-7017-47dc-a4d3-8e794d6536a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32db2925-7017-47dc-a4d3-8e794d6536a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-452047573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10abfe1f-1ecb-4b7a-b04a-0cf5909e3968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cc953b7c69748b5a46341560f4bb21b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:17Z,use_quota=True,user_id='c944b4ad12ef4375a5e6b0f88b602f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (955934eb-e521-48b0-8ffe-c4fa952be8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (955934eb-e521-48b0-8ffe-c4fa952be8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (923d0767-6253-496f-aab7-3c63d7979ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (923d0767-6253-496f-aab7-3c63d7979ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10abfe1f-1ecb-4b7a-b04a-0cf5909e3968', 'volume_name': 'volume-10abfe1f-1ecb-4b7a-b04a-0cf5909e3968', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f4871d-c471-4d8d-9cfd-22ddbf6230a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13f4871d-c471-4d8d-9cfd-22ddbf6230a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0521bb7-e5d8-408c-a1ec-b099b3707961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:17 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Volume 10abfe1f-1ecb-4b7a-b04a-0cf5909e3968: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10abfe1f-1ecb-4b7a-b04a-0cf5909e3968', 'volume_size': 1} Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:17 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f27da3cb-9837-444c-8641-52d271871ce4 tempest-VolumeDependencyTests-1472792227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.info" returned: 0 in 0.887s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:17 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-f27da3cb-9837-444c-8641-52d271871ce4 tempest-VolumeDependencyTests-1472792227 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.info is being set with open permissions: ugo+rw Jul 08 01:11:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f27da3cb-9837-444c-8641-52d271871ce4 tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:17 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.info Jul 08 01:11:17 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:18 devstack sudo[98077]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66262dc6-0e73-4663-97fc-b92c8f5b8977 tempest-SnapshotMetadataTestJSON-898275415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.155s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:18 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-66262dc6-0e73-4663-97fc-b92c8f5b8977 tempest-SnapshotMetadataTestJSON-898275415 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:11:18 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-66262dc6-0e73-4663-97fc-b92c8f5b8977 tempest-SnapshotMetadataTestJSON-898275415 None] Deleted volume successfully. Jul 08 01:11:18 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66262dc6-0e73-4663-97fc-b92c8f5b8977 tempest-SnapshotMetadataTestJSON-898275415 None] Lock "cinder-aa07a2b9-6712-4b8f-8bb6-c624a23c2e65-delete_volume" released by "delete_volume" :: held 3.760s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:18 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f27da3cb-9837-444c-8641-52d271871ce4 tempest-VolumeDependencyTests-1472792227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.info" returned: 0 in 0.942s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f27da3cb-9837-444c-8641-52d271871ce4 tempest-VolumeDependencyTests-1472792227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.400s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.221s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-452047573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10abfe1f-1ecb-4b7a-b04a-0cf5909e3968,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cc953b7c69748b5a46341560f4bb21b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:17Z,use_quota=True,user_id='c944b4ad12ef4375a5e6b0f88b602f7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:11:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Creating volume 10abfe1f-1ecb-4b7a-b04a-0cf5909e3968 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:11:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:11:18 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:11:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-10abfe1f-1ecb-4b7a-b04a-0cf5909e3968 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:18 devstack sudo[98100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-10abfe1f-1ecb-4b7a-b04a-0cf5909e3968 1073741824 Jul 08 01:11:18 devstack sudo[98100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:18 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f27da3cb-9837-444c-8641-52d271871ce4 tempest-VolumeDependencyTests-1472792227 None] Create snapshot completed successfully Jul 08 01:11:19 devstack sudo[98100]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-10abfe1f-1ecb-4b7a-b04a-0cf5909e3968 1073741824" returned: 0 in 0.970s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-10abfe1f-1ecb-4b7a-b04a-0cf5909e3968 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:19 devstack sudo[98106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-10abfe1f-1ecb-4b7a-b04a-0cf5909e3968 Jul 08 01:11:19 devstack sudo[98106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Flow 'volume_create_manager' (4a398eaa-5539-442e-886b-32473ad96dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70765bbd-baac-4ed8-b3aa-19060e99b948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70765bbd-baac-4ed8-b3aa-19060e99b948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1689169103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d83f817-9ebd-4447-90f7-9b31a692bb56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acd9107230974d8aa8c81e77db570e9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f5f8045a-bd55-4004-86f9-d2ab83ed5305,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:20Z,use_quota=True,user_id='436f3897aa154b26b592eb0ca372951e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc145b3c-6e94-4698-9831-ae89573a14fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc145b3c-6e94-4698-9831-ae89573a14fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24ca2ae-b0e2-4394-b2c8-788681877a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a24ca2ae-b0e2-4394-b2c8-788681877a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6d83f817-9ebd-4447-90f7-9b31a692bb56', 'volume_name': 'volume-6d83f817-9ebd-4447-90f7-9b31a692bb56', 'volume_size': 1, 'snapshot_id': 'f5f8045a-bd55-4004-86f9-d2ab83ed5305'}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d30ecd-575f-4adc-ab42-49ee9ff8aa42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d30ecd-575f-4adc-ab42-49ee9ff8aa42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b54151fa-126f-44c1-a080-eaebe4416996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:20 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Volume 6d83f817-9ebd-4447-90f7-9b31a692bb56: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6d83f817-9ebd-4447-90f7-9b31a692bb56', 'volume_size': 1, 'snapshot_id': 'f5f8045a-bd55-4004-86f9-d2ab83ed5305'} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:20 devstack sudo[98106]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-10abfe1f-1ecb-4b7a-b04a-0cf5909e3968" returned: 0 in 0.930s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.148s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Acquiring lock "cinder-quobyte-f5f8045a-bd55-4004-86f9-d2ab83ed5305-6d83f817-9ebd-4447-90f7-9b31a692bb56" by "_create_volume_from_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0521bb7-e5d8-408c-a1ec-b099b3707961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10abfe1f-1ecb-4b7a-b04a-0cf5909e3968', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360307e1-46c5-40a5-b109-8fd33ed2abf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Lock "cinder-quobyte-f5f8045a-bd55-4004-86f9-d2ab83ed5305-6d83f817-9ebd-4447-90f7-9b31a692bb56" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Creating volume 6d83f817-9ebd-4447-90f7-9b31a692bb56 from snapshot f5f8045a-bd55-4004-86f9-d2ab83ed5305 {{(pid=87123) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Acquiring lock "cinder-quobyte-6d83f817-9ebd-4447-90f7-9b31a692bb56" by "_copy_volume_from_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:20 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Volume volume-10abfe1f-1ecb-4b7a-b04a-0cf5909e3968 (10abfe1f-1ecb-4b7a-b04a-0cf5909e3968): created successfully Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (360307e1-46c5-40a5-b109-8fd33ed2abf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Flow 'volume_create_manager' (cba6c311-ffad-4c3f-9a6a-d6442eec2d53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Lock "cinder-quobyte-6d83f817-9ebd-4447-90f7-9b31a692bb56" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] snapshot: f5f8045a-bd55-4004-86f9-d2ab83ed5305, volume: 6d83f817-9ebd-4447-90f7-9b31a692bb56, {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:20 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b41d4347-e1b1-46cb-b6ca-203c2001b7e8 tempest-AbsoluteLimitsTests-77383735 None] Created volume successfully. Jul 08 01:11:21 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d8fb7e-15ed-414f-a6a6-911adfb6c1da]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:21 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305 Jul 08 01:11:21 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:21 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305" returned: 0 in 0.949s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:11:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:11:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Creating direct copy from snapshot {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:11:22 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[12d214a0-5d30-4ebe-bd61-cabbefa341d3]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25372458-62e3-4486-b0ce-40bd1fe8a779 tempest-AbsoluteLimitsTests-77383735 None] Acquiring lock "cinder-10abfe1f-1ecb-4b7a-b04a-0cf5909e3968-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25372458-62e3-4486-b0ce-40bd1fe8a779 tempest-AbsoluteLimitsTests-77383735 None] Lock "cinder-10abfe1f-1ecb-4b7a-b04a-0cf5909e3968-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25372458-62e3-4486-b0ce-40bd1fe8a779 tempest-AbsoluteLimitsTests-77383735 None] Acquiring lock "cinder-quobyte-10abfe1f-1ecb-4b7a-b04a-0cf5909e3968" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25372458-62e3-4486-b0ce-40bd1fe8a779 tempest-AbsoluteLimitsTests-77383735 None] Lock "cinder-quobyte-10abfe1f-1ecb-4b7a-b04a-0cf5909e3968" acquired by "delete_volume" :: waited 0.026s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:22 devstack sudo[98133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f Jul 08 01:11:22 devstack sudo[98133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:22 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[2421136a-6964-4fe5-a52f-519ec7162ce9]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25372458-62e3-4486-b0ce-40bd1fe8a779 tempest-AbsoluteLimitsTests-77383735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-10abfe1f-1ecb-4b7a-b04a-0cf5909e3968 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:22 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-10abfe1f-1ecb-4b7a-b04a-0cf5909e3968 Jul 08 01:11:22 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:23 devstack sudo[98133]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f" returned: 0 in 1.225s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:23 devstack cinder-volume[87123]: DEBUG cinder.utils [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Path /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d83f817-9ebd-4447-90f7-9b31a692bb56 not found in is_blk_device check {{(pid=87123) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:11:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d83f817-9ebd-4447-90f7-9b31a692bb56 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:23 devstack sudo[98176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d83f817-9ebd-4447-90f7-9b31a692bb56 Jul 08 01:11:23 devstack sudo[98176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:23 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25372458-62e3-4486-b0ce-40bd1fe8a779 tempest-AbsoluteLimitsTests-77383735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-10abfe1f-1ecb-4b7a-b04a-0cf5909e3968" returned: 0 in 1.150s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25372458-62e3-4486-b0ce-40bd1fe8a779 tempest-AbsoluteLimitsTests-77383735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-10abfe1f-1ecb-4b7a-b04a-0cf5909e3968 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:23 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-10abfe1f-1ecb-4b7a-b04a-0cf5909e3968 Jul 08 01:11:23 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:24 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:11:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Flow 'volume_create_manager' (94120fd2-da0b-4096-b489-f541a1f3bc50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97e7b74-1419-4060-a342-83291c1241d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:24 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:UPDATE=146,cinder:SELECT=115,cinder:DELETE=11,cinder:INSERT=37 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:11:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f97e7b74-1419-4060-a342-83291c1241d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1171473156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2abe744e-0da6-46d1-b9b1-e3ff59d605f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16d68515ec1433cb00c74eab80afec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:24Z,use_quota=True,user_id='047d63ac8400495dbf81c94f673d86c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71463fd8-5338-4578-8b8f-d8b131a54dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71463fd8-5338-4578-8b8f-d8b131a54dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:24 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da383cc3-0ef9-4813-872f-6300e60762a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da383cc3-0ef9-4813-872f-6300e60762a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2abe744e-0da6-46d1-b9b1-e3ff59d605f6', 'volume_name': 'volume-2abe744e-0da6-46d1-b9b1-e3ff59d605f6', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3967e0-87df-47b7-b65a-d280d65ff464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d3967e0-87df-47b7-b65a-d280d65ff464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd5796c-5214-410b-ad5d-48f0a1dfd68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:24 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Volume 2abe744e-0da6-46d1-b9b1-e3ff59d605f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2abe744e-0da6-46d1-b9b1-e3ff59d605f6', 'volume_size': 1} Jul 08 01:11:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25372458-62e3-4486-b0ce-40bd1fe8a779 tempest-AbsoluteLimitsTests-77383735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-10abfe1f-1ecb-4b7a-b04a-0cf5909e3968" returned: 0 in 1.003s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25372458-62e3-4486-b0ce-40bd1fe8a779 tempest-AbsoluteLimitsTests-77383735 None] Lock "cinder-quobyte-10abfe1f-1ecb-4b7a-b04a-0cf5909e3968" released by "delete_volume" :: held 2.263s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:24 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-25372458-62e3-4486-b0ce-40bd1fe8a779 tempest-AbsoluteLimitsTests-77383735 None] Created reservations ['5b05e692-ef8a-469d-8bc2-a464846a8b8e', '8a407207-d0c1-4513-835c-054c9822b092', '4281483e-23a3-4c13-b6a3-f2d6cdd5e541', 'cb62199c-eade-40f9-8a87-ad7bb1bb9ba2'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:11:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-25372458-62e3-4486-b0ce-40bd1fe8a779 tempest-AbsoluteLimitsTests-77383735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-25372458-62e3-4486-b0ce-40bd1fe8a779 tempest-AbsoluteLimitsTests-77383735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-25372458-62e3-4486-b0ce-40bd1fe8a779 tempest-AbsoluteLimitsTests-77383735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-25372458-62e3-4486-b0ce-40bd1fe8a779 tempest-AbsoluteLimitsTests-77383735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-25372458-62e3-4486-b0ce-40bd1fe8a779 tempest-AbsoluteLimitsTests-77383735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25372458-62e3-4486-b0ce-40bd1fe8a779 tempest-AbsoluteLimitsTests-77383735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:24 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:11:24 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:26 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25372458-62e3-4486-b0ce-40bd1fe8a779 tempest-AbsoluteLimitsTests-77383735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.939s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:26 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-25372458-62e3-4486-b0ce-40bd1fe8a779 tempest-AbsoluteLimitsTests-77383735 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:11:26 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-25372458-62e3-4486-b0ce-40bd1fe8a779 tempest-AbsoluteLimitsTests-77383735 None] Deleted volume successfully. Jul 08 01:11:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25372458-62e3-4486-b0ce-40bd1fe8a779 tempest-AbsoluteLimitsTests-77383735 None] Lock "cinder-10abfe1f-1ecb-4b7a-b04a-0cf5909e3968-delete_volume" released by "delete_volume" :: held 4.670s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:27 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-46f16c47-b46b-427a-bbe0-7d7276fe0825 tempest-VolumesActionsTest-1485080785 None] Acquiring lock "cinder-99dce23f-6c80-49ed-858d-bdebbb19cfa2" by "attach_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-46f16c47-b46b-427a-bbe0-7d7276fe0825 tempest-VolumesActionsTest-1485080785 None] Lock "cinder-99dce23f-6c80-49ed-858d-bdebbb19cfa2" acquired by "attach_volume" :: waited 0.056s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:28 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-46f16c47-b46b-427a-bbe0-7d7276fe0825 tempest-VolumesActionsTest-1485080785 None] Attaching volume 99dce23f-6c80-49ed-858d-bdebbb19cfa2 to instance 61fc3ffe-436a-4ad7-84c7-bbdabf9cb70a at mountpoint /dev/vdb on host None. Jul 08 01:11:28 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-46f16c47-b46b-427a-bbe0-7d7276fe0825 tempest-VolumesActionsTest-1485080785 None] Attach volume completed successfully. Jul 08 01:11:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-46f16c47-b46b-427a-bbe0-7d7276fe0825 tempest-VolumesActionsTest-1485080785 None] Lock "cinder-99dce23f-6c80-49ed-858d-bdebbb19cfa2" released by "attach_volume" :: held 0.271s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:29 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-08d2ee64-5312-45c4-9c36-3c526d80e771 tempest-VolumesActionsTest-1485080785 None] Acquiring lock "cinder-99dce23f-6c80-49ed-858d-bdebbb19cfa2-detach_volume" by "detach_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:29 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-08d2ee64-5312-45c4-9c36-3c526d80e771 tempest-VolumesActionsTest-1485080785 None] Lock "cinder-99dce23f-6c80-49ed-858d-bdebbb19cfa2-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:29 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-08d2ee64-5312-45c4-9c36-3c526d80e771 tempest-VolumesActionsTest-1485080785 None] Detaching volume 99dce23f-6c80-49ed-858d-bdebbb19cfa2 from instance 61fc3ffe-436a-4ad7-84c7-bbdabf9cb70a. Jul 08 01:11:29 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-08d2ee64-5312-45c4-9c36-3c526d80e771 tempest-VolumesActionsTest-1485080785 None] Detach volume completed successfully. Jul 08 01:11:29 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-08d2ee64-5312-45c4-9c36-3c526d80e771 tempest-VolumesActionsTest-1485080785 None] Lock "cinder-99dce23f-6c80-49ed-858d-bdebbb19cfa2-detach_volume" released by "detach_volume" :: held 0.181s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:31 devstack sudo[98176]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d83f817-9ebd-4447-90f7-9b31a692bb56" returned: 0 in 7.890s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:31 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71fefc2-861d-4e93-ab1b-bb75b5b15f7d]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:31 devstack sudo[98222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f Jul 08 01:11:31 devstack sudo[98222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:32 devstack sudo[98222]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f" returned: 0 in 1.101s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:32 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Image conversion details: src /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f, size 1024.00 MB, duration 7.89 sec, destination /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d83f817-9ebd-4447-90f7-9b31a692bb56 {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:11:32 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Converted 1024.00 MB image at 129.77 MB/s Jul 08 01:11:32 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d83f817-9ebd-4447-90f7-9b31a692bb56 is being set with open permissions: ugo+rw Jul 08 01:11:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d83f817-9ebd-4447-90f7-9b31a692bb56 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:32 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d83f817-9ebd-4447-90f7-9b31a692bb56 Jul 08 01:11:32 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:33 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d83f817-9ebd-4447-90f7-9b31a692bb56" returned: 0 in 1.006s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Lock "cinder-quobyte-6d83f817-9ebd-4447-90f7-9b31a692bb56" released by "_copy_volume_from_snapshot" :: held 12.337s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Lock "cinder-quobyte-f5f8045a-bd55-4004-86f9-d2ab83ed5305-6d83f817-9ebd-4447-90f7-9b31a692bb56" released by "_create_volume_from_snapshot" :: held 12.406s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.443s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.861s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1171473156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2abe744e-0da6-46d1-b9b1-e3ff59d605f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16d68515ec1433cb00c74eab80afec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:24Z,use_quota=True,user_id='047d63ac8400495dbf81c94f673d86c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:11:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Creating volume 2abe744e-0da6-46d1-b9b1-e3ff59d605f6 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:11:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:11:33 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:11:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2abe744e-0da6-46d1-b9b1-e3ff59d605f6 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:33 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2abe744e-0da6-46d1-b9b1-e3ff59d605f6 1073741824 Jul 08 01:11:33 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b54151fa-126f-44c1-a080-eaebe4416996) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d83f817-9ebd-4447-90f7-9b31a692bb56', 'volume_size': 1, 'snapshot_id': 'f5f8045a-bd55-4004-86f9-d2ab83ed5305'}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae5210a1-f94a-4f64-870e-850fa75db232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:33 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Volume volume-6d83f817-9ebd-4447-90f7-9b31a692bb56 (6d83f817-9ebd-4447-90f7-9b31a692bb56): created successfully Jul 08 01:11:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae5210a1-f94a-4f64-870e-850fa75db232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Flow 'volume_create_manager' (4a398eaa-5539-442e-886b-32473ad96dd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:33 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b24986c9-e23a-440c-80c1-bd582a220a85 tempest-VolumeDependencyTests-1472792227 None] Created volume successfully. Jul 08 01:11:34 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-68c39186-878a-435a-86ff-9b608cc88d48 tempest-VolumeDependencyTests-1472792227 None] Acquiring lock "cinder-f5f8045a-bd55-4004-86f9-d2ab83ed5305-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:34 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-68c39186-878a-435a-86ff-9b608cc88d48 tempest-VolumeDependencyTests-1472792227 None] Lock "cinder-f5f8045a-bd55-4004-86f9-d2ab83ed5305-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:34 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-68c39186-878a-435a-86ff-9b608cc88d48 tempest-VolumeDependencyTests-1472792227 None] Acquiring lock "cinder-quobyte-55ac1be2-3e8d-4ed2-92b9-35bde483b59f" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:34 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2abe744e-0da6-46d1-b9b1-e3ff59d605f6 1073741824" returned: 0 in 1.079s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:34 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-68c39186-878a-435a-86ff-9b608cc88d48 tempest-VolumeDependencyTests-1472792227 None] Lock "cinder-quobyte-55ac1be2-3e8d-4ed2-92b9-35bde483b59f" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:34 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-68c39186-878a-435a-86ff-9b608cc88d48 tempest-VolumeDependencyTests-1472792227 None] Acquiring lock "cinder-quobyte-f5f8045a-bd55-4004-86f9-d2ab83ed5305" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:34 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-68c39186-878a-435a-86ff-9b608cc88d48 tempest-VolumeDependencyTests-1472792227 None] Lock "cinder-quobyte-f5f8045a-bd55-4004-86f9-d2ab83ed5305" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-68c39186-878a-435a-86ff-9b608cc88d48 tempest-VolumeDependencyTests-1472792227 None] Deleting offline snapshot f5f8045a-bd55-4004-86f9-d2ab83ed5305 of volume 55ac1be2-3e8d-4ed2-92b9-35bde483b59f {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:11:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-68c39186-878a-435a-86ff-9b608cc88d48 tempest-VolumeDependencyTests-1472792227 None] snapshot_file for this snap is: volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:11:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2abe744e-0da6-46d1-b9b1-e3ff59d605f6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:34 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[13791553-facf-45c5-a8f8-09ed7fe2a872]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68c39186-878a-435a-86ff-9b608cc88d48 tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:34 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2abe744e-0da6-46d1-b9b1-e3ff59d605f6 Jul 08 01:11:34 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:34 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305 Jul 08 01:11:34 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:35 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2abe744e-0da6-46d1-b9b1-e3ff59d605f6" returned: 0 in 0.785s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] <== create_volume: return (1949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:11:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.956s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5dd5796c-5214-410b-ad5d-48f0a1dfd68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2abe744e-0da6-46d1-b9b1-e3ff59d605f6', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9b7099-f3b5-40ce-a220-267b78bcf83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:35 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Volume volume-2abe744e-0da6-46d1-b9b1-e3ff59d605f6 (2abe744e-0da6-46d1-b9b1-e3ff59d605f6): created successfully Jul 08 01:11:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd9b7099-f3b5-40ce-a220-267b78bcf83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Flow 'volume_create_manager' (94120fd2-da0b-4096-b489-f541a1f3bc50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:35 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=115,cinder:INSERT=35,cinder:UPDATE=141,cinder:DELETE=14 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:11:35 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-64c39728-63bf-4ffd-a0fe-3ed1b1a84c2b tempest-VolumesTransfersV357Test-68563375 None] Created volume successfully. Jul 08 01:11:35 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68c39186-878a-435a-86ff-9b608cc88d48 tempest-VolumeDependencyTests-1472792227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305" returned: 0 in 0.886s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-68c39186-878a-435a-86ff-9b608cc88d48 tempest-VolumeDependencyTests-1472792227 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:11:35 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[4593ab98-86fa-4f1f-928b-9a7fd2378c37]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68c39186-878a-435a-86ff-9b608cc88d48 tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:35 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f Jul 08 01:11:35 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:36 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68c39186-878a-435a-86ff-9b608cc88d48 tempest-VolumeDependencyTests-1472792227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f" returned: 0 in 0.907s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68c39186-878a-435a-86ff-9b608cc88d48 tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:36 devstack sudo[98273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305 Jul 08 01:11:36 devstack sudo[98273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:36 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-330bc2dd-ad68-469a-a214-1c93fc341c3b tempest-VolumesTransfersV357Test-1993935620 None] Transfer volume completed successfully. Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Flow 'volume_create_manager' (926197ac-9d82-4815-aded-0e8a465d446d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78cf07e-2a20-41f5-b7e5-2ae32c1086a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b78cf07e-2a20-41f5-b7e5-2ae32c1086a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1400682755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff21bdae-3446-4daa-bb56-96f49c89dcfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a836033a39b643b2995e2f8d6a399d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:37Z,use_quota=True,user_id='d62815da100f4cd28fa41b769106c915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd88df3-8380-4a48-bca9-f134afd497d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cd88df3-8380-4a48-bca9-f134afd497d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f2f5b2-a255-43b4-b0bd-d2ade9a61c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80f2f5b2-a255-43b4-b0bd-d2ade9a61c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff21bdae-3446-4daa-bb56-96f49c89dcfd', 'volume_name': 'volume-ff21bdae-3446-4daa-bb56-96f49c89dcfd', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451fd514-4cd9-4bd4-abfa-111718203c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (451fd514-4cd9-4bd4-abfa-111718203c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd014b9-a6eb-4a7c-a043-912e1b955c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:36 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Volume ff21bdae-3446-4daa-bb56-96f49c89dcfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff21bdae-3446-4daa-bb56-96f49c89dcfd', 'volume_size': 1} Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:11:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1400682755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff21bdae-3446-4daa-bb56-96f49c89dcfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a836033a39b643b2995e2f8d6a399d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:37Z,use_quota=True,user_id='d62815da100f4cd28fa41b769106c915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Creating volume ff21bdae-3446-4daa-bb56-96f49c89dcfd {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:11:36 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:11:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ff21bdae-3446-4daa-bb56-96f49c89dcfd 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:36 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ff21bdae-3446-4daa-bb56-96f49c89dcfd 1073741824 Jul 08 01:11:36 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:37 devstack sudo[98273]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68c39186-878a-435a-86ff-9b608cc88d48 tempest-VolumeDependencyTests-1472792227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305" returned: 0 in 0.855s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68c39186-878a-435a-86ff-9b608cc88d48 tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:37 devstack sudo[98280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305 Jul 08 01:11:37 devstack sudo[98280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:38 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ff21bdae-3446-4daa-bb56-96f49c89dcfd 1073741824" returned: 0 in 1.127s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:38 devstack sudo[98280]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68c39186-878a-435a-86ff-9b608cc88d48 tempest-VolumeDependencyTests-1472792227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f.f5f8045a-bd55-4004-86f9-d2ab83ed5305" returned: 0 in 0.906s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ff21bdae-3446-4daa-bb56-96f49c89dcfd {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3d99a1ce-8ece-49ae-85a9-d3d2fae36237 tempest-VolumesTransfersV357Test-411518804 None] Acquiring lock "cinder-2abe744e-0da6-46d1-b9b1-e3ff59d605f6-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:38 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ff21bdae-3446-4daa-bb56-96f49c89dcfd Jul 08 01:11:38 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3d99a1ce-8ece-49ae-85a9-d3d2fae36237 tempest-VolumesTransfersV357Test-411518804 None] Lock "cinder-2abe744e-0da6-46d1-b9b1-e3ff59d605f6-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-68c39186-878a-435a-86ff-9b608cc88d48 tempest-VolumeDependencyTests-1472792227 None] Lock "cinder-quobyte-f5f8045a-bd55-4004-86f9-d2ab83ed5305" released by "_delete_snapshot" :: held 3.716s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-68c39186-878a-435a-86ff-9b608cc88d48 tempest-VolumeDependencyTests-1472792227 None] Lock "cinder-quobyte-55ac1be2-3e8d-4ed2-92b9-35bde483b59f" released by "delete_snapshot" :: held 3.751s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3d99a1ce-8ece-49ae-85a9-d3d2fae36237 tempest-VolumesTransfersV357Test-411518804 None] Acquiring lock "cinder-quobyte-2abe744e-0da6-46d1-b9b1-e3ff59d605f6" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3d99a1ce-8ece-49ae-85a9-d3d2fae36237 tempest-VolumesTransfersV357Test-411518804 None] Lock "cinder-quobyte-2abe744e-0da6-46d1-b9b1-e3ff59d605f6" acquired by "delete_volume" :: waited 0.033s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2aec43-4d8c-45fc-bd0f-ad9b06b5ee81]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3d99a1ce-8ece-49ae-85a9-d3d2fae36237 tempest-VolumesTransfersV357Test-411518804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2abe744e-0da6-46d1-b9b1-e3ff59d605f6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-68c39186-878a-435a-86ff-9b608cc88d48 tempest-VolumeDependencyTests-1472792227 None] Created reservations ['d902ce40-1661-4db6-9cf1-b4ec4793a234', '97c8bfe2-6156-4464-98b3-8486af6d95a8', '6c25b5b9-88f1-461d-81c9-37b7354f4727', '4328f799-8ef7-4bdf-9f4b-67636489a22b'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:11:38 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-68c39186-878a-435a-86ff-9b608cc88d48 tempest-VolumeDependencyTests-1472792227 None] Delete snapshot completed successfully. Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-68c39186-878a-435a-86ff-9b608cc88d48 tempest-VolumeDependencyTests-1472792227 None] Lock "cinder-f5f8045a-bd55-4004-86f9-d2ab83ed5305-delete_snapshot" released by "delete_snapshot" :: held 4.032s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:38 devstack sudo[98289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2abe744e-0da6-46d1-b9b1-e3ff59d605f6 Jul 08 01:11:38 devstack sudo[98289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e644c45e-ccdf-4dae-b95a-88f419d5c4ac tempest-VolumeDependencyTests-1472792227 None] Acquiring lock "cinder-55ac1be2-3e8d-4ed2-92b9-35bde483b59f-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e644c45e-ccdf-4dae-b95a-88f419d5c4ac tempest-VolumeDependencyTests-1472792227 None] Lock "cinder-55ac1be2-3e8d-4ed2-92b9-35bde483b59f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:38 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ff21bdae-3446-4daa-bb56-96f49c89dcfd" returned: 0 in 0.763s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7fd014b9-a6eb-4a7c-a043-912e1b955c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff21bdae-3446-4daa-bb56-96f49c89dcfd', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01562ee1-644f-4074-ba11-82f4c6c5b2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e644c45e-ccdf-4dae-b95a-88f419d5c4ac tempest-VolumeDependencyTests-1472792227 None] Acquiring lock "cinder-quobyte-55ac1be2-3e8d-4ed2-92b9-35bde483b59f" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:38 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Volume volume-ff21bdae-3446-4daa-bb56-96f49c89dcfd (ff21bdae-3446-4daa-bb56-96f49c89dcfd): created successfully Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01562ee1-644f-4074-ba11-82f4c6c5b2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Flow 'volume_create_manager' (926197ac-9d82-4815-aded-0e8a465d446d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e644c45e-ccdf-4dae-b95a-88f419d5c4ac tempest-VolumeDependencyTests-1472792227 None] Lock "cinder-quobyte-55ac1be2-3e8d-4ed2-92b9-35bde483b59f" acquired by "delete_volume" :: waited 0.031s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:38 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-9b41f822-34ac-419a-8ef7-7341b0997afd tempest-VolumesTransfersV355Test-1741092954 None] Created volume successfully. Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d54365-9a6d-4205-a92e-acea437d673b]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e644c45e-ccdf-4dae-b95a-88f419d5c4ac tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:39 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f Jul 08 01:11:39 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:39 devstack sudo[98289]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3d99a1ce-8ece-49ae-85a9-d3d2fae36237 tempest-VolumesTransfersV357Test-411518804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2abe744e-0da6-46d1-b9b1-e3ff59d605f6" returned: 0 in 0.967s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3d99a1ce-8ece-49ae-85a9-d3d2fae36237 tempest-VolumesTransfersV357Test-411518804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2abe744e-0da6-46d1-b9b1-e3ff59d605f6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:39 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2abe744e-0da6-46d1-b9b1-e3ff59d605f6 Jul 08 01:11:39 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b39edc13-0f60-417e-bc9a-ad6558f4ab98 tempest-VolumesActionsTest-1485080785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b39edc13-0f60-417e-bc9a-ad6558f4ab98 tempest-VolumesActionsTest-1485080785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:39 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e27198-7e38-45ae-bf25-ce24ab8ccfaf]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b39edc13-0f60-417e-bc9a-ad6558f4ab98 tempest-VolumesActionsTest-1485080785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:39 devstack sudo[98299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 Jul 08 01:11:39 devstack sudo[98299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:39 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e644c45e-ccdf-4dae-b95a-88f419d5c4ac tempest-VolumeDependencyTests-1472792227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f" returned: 0 in 0.895s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e644c45e-ccdf-4dae-b95a-88f419d5c4ac tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:39 devstack sudo[98306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f Jul 08 01:11:39 devstack sudo[98306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:40 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3d99a1ce-8ece-49ae-85a9-d3d2fae36237 tempest-VolumesTransfersV357Test-411518804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2abe744e-0da6-46d1-b9b1-e3ff59d605f6" returned: 0 in 0.868s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3d99a1ce-8ece-49ae-85a9-d3d2fae36237 tempest-VolumesTransfersV357Test-411518804 None] Lock "cinder-quobyte-2abe744e-0da6-46d1-b9b1-e3ff59d605f6" released by "delete_volume" :: held 1.911s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:40 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-3d99a1ce-8ece-49ae-85a9-d3d2fae36237 tempest-VolumesTransfersV357Test-411518804 None] Created reservations ['71db7f63-f4c9-47c0-afbe-3c05ad8f600a', '3d3870ba-8a44-464c-989e-094d9c9285bc', '93ae68c5-5cb4-4d0a-922f-4f7a6b04efe7', '2c06a018-1a45-4f68-9b74-c3b1fd3a3ce1'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:11:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3d99a1ce-8ece-49ae-85a9-d3d2fae36237 tempest-VolumesTransfersV357Test-411518804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3d99a1ce-8ece-49ae-85a9-d3d2fae36237 tempest-VolumesTransfersV357Test-411518804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3d99a1ce-8ece-49ae-85a9-d3d2fae36237 tempest-VolumesTransfersV357Test-411518804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3d99a1ce-8ece-49ae-85a9-d3d2fae36237 tempest-VolumesTransfersV357Test-411518804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3d99a1ce-8ece-49ae-85a9-d3d2fae36237 tempest-VolumesTransfersV357Test-411518804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3d99a1ce-8ece-49ae-85a9-d3d2fae36237 tempest-VolumesTransfersV357Test-411518804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:40 devstack sudo[98312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:11:40 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:40 devstack sudo[98299]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b39edc13-0f60-417e-bc9a-ad6558f4ab98 tempest-VolumesActionsTest-1485080785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2" returned: 0 in 1.048s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:40 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc624334-d6cc-45d3-964e-ccf731d9e05d]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b39edc13-0f60-417e-bc9a-ad6558f4ab98 tempest-VolumesActionsTest-1485080785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:40 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 Jul 08 01:11:40 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:40 devstack sudo[98306]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e644c45e-ccdf-4dae-b95a-88f419d5c4ac tempest-VolumeDependencyTests-1472792227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-55ac1be2-3e8d-4ed2-92b9-35bde483b59f" returned: 0 in 1.067s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e644c45e-ccdf-4dae-b95a-88f419d5c4ac tempest-VolumeDependencyTests-1472792227 None] Lock "cinder-quobyte-55ac1be2-3e8d-4ed2-92b9-35bde483b59f" released by "delete_volume" :: held 2.075s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-e644c45e-ccdf-4dae-b95a-88f419d5c4ac tempest-VolumeDependencyTests-1472792227 None] Created reservations ['d148dd15-0207-473f-a15e-3045c0128a7d', '1802a71c-7cab-4464-89fc-6aa9eda8b1bd', '6f06f328-192f-40dc-b8c0-57908888f0cb', '9ac1b06b-5904-4a78-8a06-4cb2fd6ae64d'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:11:41 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-fc5d45c4-904c-4526-93ef-c898239b7961 tempest-VolumesTransfersV355Test-1366691445 None] Transfer volume completed successfully. Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Flow 'volume_create_manager' (50b040f9-b8e2-4883-89c7-c9c33ea2dc4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396e0795-292b-4336-8a81-08e19a9a84a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (396e0795-292b-4336-8a81-08e19a9a84a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1250910783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=135d7113-5491-4133-a86c-8bedc2e2695f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16d68515ec1433cb00c74eab80afec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:41Z,use_quota=True,user_id='047d63ac8400495dbf81c94f673d86c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c91966-7cd1-4d5a-8917-6651decc8422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c91966-7cd1-4d5a-8917-6651decc8422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2c5a31-c58e-4ddf-920c-db1e4b892c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2c5a31-c58e-4ddf-920c-db1e4b892c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '135d7113-5491-4133-a86c-8bedc2e2695f', 'volume_name': 'volume-135d7113-5491-4133-a86c-8bedc2e2695f', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9248be-42f3-4e6c-8eee-bc1bb72d7fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f9248be-42f3-4e6c-8eee-bc1bb72d7fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28dad89-49f0-4e02-9dbd-8766cfa080f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:41 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Volume 135d7113-5491-4133-a86c-8bedc2e2695f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-135d7113-5491-4133-a86c-8bedc2e2695f', 'volume_size': 1} Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e644c45e-ccdf-4dae-b95a-88f419d5c4ac tempest-VolumeDependencyTests-1472792227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e644c45e-ccdf-4dae-b95a-88f419d5c4ac tempest-VolumeDependencyTests-1472792227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e644c45e-ccdf-4dae-b95a-88f419d5c4ac tempest-VolumeDependencyTests-1472792227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e644c45e-ccdf-4dae-b95a-88f419d5c4ac tempest-VolumeDependencyTests-1472792227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e644c45e-ccdf-4dae-b95a-88f419d5c4ac tempest-VolumeDependencyTests-1472792227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e644c45e-ccdf-4dae-b95a-88f419d5c4ac tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:41 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3d99a1ce-8ece-49ae-85a9-d3d2fae36237 tempest-VolumesTransfersV357Test-411518804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.041s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-3d99a1ce-8ece-49ae-85a9-d3d2fae36237 tempest-VolumesTransfersV357Test-411518804 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:11:41 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-3d99a1ce-8ece-49ae-85a9-d3d2fae36237 tempest-VolumesTransfersV357Test-411518804 None] Deleted volume successfully. Jul 08 01:11:41 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:11:41 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3d99a1ce-8ece-49ae-85a9-d3d2fae36237 tempest-VolumesTransfersV357Test-411518804 None] Lock "cinder-2abe744e-0da6-46d1-b9b1-e3ff59d605f6-delete_volume" released by "delete_volume" :: held 3.374s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:41 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b39edc13-0f60-417e-bc9a-ad6558f4ab98 tempest-VolumesActionsTest-1485080785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2" returned: 0 in 1.163s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b39edc13-0f60-417e-bc9a-ad6558f4ab98 tempest-VolumesActionsTest-1485080785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 /opt/stack/data/cinder/conversion/99dce23f-6c80-49ed-858d-bdebbb19cfa2.temp_image.e8f48768-d73e-41b1-9e51-3b84c7972a802euaa7r2.img {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:41 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 /opt/stack/data/cinder/conversion/99dce23f-6c80-49ed-858d-bdebbb19cfa2.temp_image.e8f48768-d73e-41b1-9e51-3b84c7972a802euaa7r2.img Jul 08 01:11:41 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:42 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e644c45e-ccdf-4dae-b95a-88f419d5c4ac tempest-VolumeDependencyTests-1472792227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.727s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:42 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-e644c45e-ccdf-4dae-b95a-88f419d5c4ac tempest-VolumeDependencyTests-1472792227 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:11:42 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-e644c45e-ccdf-4dae-b95a-88f419d5c4ac tempest-VolumeDependencyTests-1472792227 None] Deleted volume successfully. Jul 08 01:11:42 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1bf1e85a-3bf5-42c8-9e35-a8ed45d8b86a tempest-VolumeDependencyTests-1472792227 None] Acquiring lock "cinder-6d83f817-9ebd-4447-90f7-9b31a692bb56-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:42 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1bf1e85a-3bf5-42c8-9e35-a8ed45d8b86a tempest-VolumeDependencyTests-1472792227 None] Lock "cinder-6d83f817-9ebd-4447-90f7-9b31a692bb56-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:42 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3118cb34-107e-44a5-a30b-456995905fe8 tempest-VolumesTransfersV355Test-2060697669 None] Acquiring lock "cinder-ff21bdae-3446-4daa-bb56-96f49c89dcfd-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:42 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e644c45e-ccdf-4dae-b95a-88f419d5c4ac tempest-VolumeDependencyTests-1472792227 None] Lock "cinder-55ac1be2-3e8d-4ed2-92b9-35bde483b59f-delete_volume" released by "delete_volume" :: held 3.487s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:42 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3118cb34-107e-44a5-a30b-456995905fe8 tempest-VolumesTransfersV355Test-2060697669 None] Lock "cinder-ff21bdae-3446-4daa-bb56-96f49c89dcfd-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:42 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1bf1e85a-3bf5-42c8-9e35-a8ed45d8b86a tempest-VolumeDependencyTests-1472792227 None] Acquiring lock "cinder-quobyte-6d83f817-9ebd-4447-90f7-9b31a692bb56" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:42 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3118cb34-107e-44a5-a30b-456995905fe8 tempest-VolumesTransfersV355Test-2060697669 None] Acquiring lock "cinder-quobyte-ff21bdae-3446-4daa-bb56-96f49c89dcfd" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:11:42 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1bf1e85a-3bf5-42c8-9e35-a8ed45d8b86a tempest-VolumeDependencyTests-1472792227 None] Lock "cinder-quobyte-6d83f817-9ebd-4447-90f7-9b31a692bb56" acquired by "delete_volume" :: waited 0.033s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:42 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3118cb34-107e-44a5-a30b-456995905fe8 tempest-VolumesTransfersV355Test-2060697669 None] Lock "cinder-quobyte-ff21bdae-3446-4daa-bb56-96f49c89dcfd" acquired by "delete_volume" :: waited 0.033s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:11:42 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[eedcf686-8c27-4849-a602-0ebd7a16ff90]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1bf1e85a-3bf5-42c8-9e35-a8ed45d8b86a tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d83f817-9ebd-4447-90f7-9b31a692bb56 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:42 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdf3967b-c407-4c6a-ae83-6c01b6e0ef73]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3118cb34-107e-44a5-a30b-456995905fe8 tempest-VolumesTransfersV355Test-2060697669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ff21bdae-3446-4daa-bb56-96f49c89dcfd {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:42 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d83f817-9ebd-4447-90f7-9b31a692bb56 Jul 08 01:11:42 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:42 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ff21bdae-3446-4daa-bb56-96f49c89dcfd Jul 08 01:11:42 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:44 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3118cb34-107e-44a5-a30b-456995905fe8 tempest-VolumesTransfersV355Test-2060697669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ff21bdae-3446-4daa-bb56-96f49c89dcfd" returned: 0 in 1.639s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3118cb34-107e-44a5-a30b-456995905fe8 tempest-VolumesTransfersV355Test-2060697669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ff21bdae-3446-4daa-bb56-96f49c89dcfd {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:44 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ff21bdae-3446-4daa-bb56-96f49c89dcfd Jul 08 01:11:44 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:44 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1bf1e85a-3bf5-42c8-9e35-a8ed45d8b86a tempest-VolumeDependencyTests-1472792227 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d83f817-9ebd-4447-90f7-9b31a692bb56" returned: 0 in 1.752s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1bf1e85a-3bf5-42c8-9e35-a8ed45d8b86a tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d83f817-9ebd-4447-90f7-9b31a692bb56 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:44 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d83f817-9ebd-4447-90f7-9b31a692bb56 Jul 08 01:11:44 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:11:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:45 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:11:45 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:45 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1bf1e85a-3bf5-42c8-9e35-a8ed45d8b86a tempest-VolumeDependencyTests-1472792227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d83f817-9ebd-4447-90f7-9b31a692bb56" returned: 0 in 1.770s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1bf1e85a-3bf5-42c8-9e35-a8ed45d8b86a tempest-VolumeDependencyTests-1472792227 None] Lock "cinder-quobyte-6d83f817-9ebd-4447-90f7-9b31a692bb56" released by "delete_volume" :: held 3.615s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:46 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3118cb34-107e-44a5-a30b-456995905fe8 tempest-VolumesTransfersV355Test-2060697669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ff21bdae-3446-4daa-bb56-96f49c89dcfd" returned: 0 in 1.972s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3118cb34-107e-44a5-a30b-456995905fe8 tempest-VolumesTransfersV355Test-2060697669 None] Lock "cinder-quobyte-ff21bdae-3446-4daa-bb56-96f49c89dcfd" released by "delete_volume" :: held 3.668s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:46 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-1bf1e85a-3bf5-42c8-9e35-a8ed45d8b86a tempest-VolumeDependencyTests-1472792227 None] Created reservations ['bb34eb83-e109-480b-96be-587c5da02e8a', '4d4e6fd1-267a-46b4-b347-c319368d1fec', '4b349b05-8a94-47b9-ac77-ba234f32bd1d', '4a834b2b-d349-4bb2-b37c-4773d940efdb'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:11:46 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-3118cb34-107e-44a5-a30b-456995905fe8 tempest-VolumesTransfersV355Test-2060697669 None] Created reservations ['de509edc-8bbe-4495-b4dd-a6115c1ea34b', '78c2ccde-8233-48af-a291-683dd97ab6aa', 'adc6de53-246c-4811-bc6f-ab1f7c26156c', 'cfc56c30-57e7-4c18-952f-2e76cf73e02b'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:11:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1bf1e85a-3bf5-42c8-9e35-a8ed45d8b86a tempest-VolumeDependencyTests-1472792227 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1bf1e85a-3bf5-42c8-9e35-a8ed45d8b86a tempest-VolumeDependencyTests-1472792227 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1bf1e85a-3bf5-42c8-9e35-a8ed45d8b86a tempest-VolumeDependencyTests-1472792227 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1bf1e85a-3bf5-42c8-9e35-a8ed45d8b86a tempest-VolumeDependencyTests-1472792227 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1bf1e85a-3bf5-42c8-9e35-a8ed45d8b86a tempest-VolumeDependencyTests-1472792227 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1bf1e85a-3bf5-42c8-9e35-a8ed45d8b86a tempest-VolumeDependencyTests-1472792227 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3118cb34-107e-44a5-a30b-456995905fe8 tempest-VolumesTransfersV355Test-2060697669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3118cb34-107e-44a5-a30b-456995905fe8 tempest-VolumesTransfersV355Test-2060697669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:11:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3118cb34-107e-44a5-a30b-456995905fe8 tempest-VolumesTransfersV355Test-2060697669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:11:46 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:11:46 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3118cb34-107e-44a5-a30b-456995905fe8 tempest-VolumesTransfersV355Test-2060697669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:11:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3118cb34-107e-44a5-a30b-456995905fe8 tempest-VolumesTransfersV355Test-2060697669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:11:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3118cb34-107e-44a5-a30b-456995905fe8 tempest-VolumesTransfersV355Test-2060697669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:46 devstack sudo[98359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:11:46 devstack sudo[98359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:47 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 2.451s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:47 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:11:47 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:11:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 28 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:11:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:11:47 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b39edc13-0f60-417e-bc9a-ad6558f4ab98 tempest-VolumesActionsTest-1485080785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 /opt/stack/data/cinder/conversion/99dce23f-6c80-49ed-858d-bdebbb19cfa2.temp_image.e8f48768-d73e-41b1-9e51-3b84c7972a802euaa7r2.img" returned: 0 in 5.698s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:47 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[635cc090-5049-4064-b91a-fdf316540696]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:11:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b39edc13-0f60-417e-bc9a-ad6558f4ab98 tempest-VolumesActionsTest-1485080785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:11:47 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 Jul 08 01:11:47 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:11:47 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1bf1e85a-3bf5-42c8-9e35-a8ed45d8b86a tempest-VolumeDependencyTests-1472792227 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.343s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:47 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-1bf1e85a-3bf5-42c8-9e35-a8ed45d8b86a tempest-VolumeDependencyTests-1472792227 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:11:47 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-1bf1e85a-3bf5-42c8-9e35-a8ed45d8b86a tempest-VolumeDependencyTests-1472792227 None] Deleted volume successfully. Jul 08 01:11:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1bf1e85a-3bf5-42c8-9e35-a8ed45d8b86a tempest-VolumeDependencyTests-1472792227 None] Lock "cinder-6d83f817-9ebd-4447-90f7-9b31a692bb56-delete_volume" released by "delete_volume" :: held 5.650s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:47 devstack sudo[98359]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3118cb34-107e-44a5-a30b-456995905fe8 tempest-VolumesTransfersV355Test-2060697669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.346s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:47 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-3118cb34-107e-44a5-a30b-456995905fe8 tempest-VolumesTransfersV355Test-2060697669 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:11:47 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-3118cb34-107e-44a5-a30b-456995905fe8 tempest-VolumesTransfersV355Test-2060697669 None] Deleted volume successfully. Jul 08 01:11:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3118cb34-107e-44a5-a30b-456995905fe8 tempest-VolumesTransfersV355Test-2060697669 None] Lock "cinder-ff21bdae-3446-4daa-bb56-96f49c89dcfd-delete_volume" released by "delete_volume" :: held 5.648s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:11:47 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:11:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Flow 'volume_create_manager' (512793df-b74e-48b6-babe-4ac58cfff7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37aa8c6-9382-4d77-b9a7-d2bf13248d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d37aa8c6-9382-4d77-b9a7-d2bf13248d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-341308109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef2c893-8b2d-4d63-a8fa-d607ba532c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a836033a39b643b2995e2f8d6a399d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:48Z,use_quota=True,user_id='d62815da100f4cd28fa41b769106c915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b90da6-464c-4a77-b0d6-dd248d0ca1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b90da6-464c-4a77-b0d6-dd248d0ca1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ff230b-0b48-4717-86ba-3b42c1400ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70ff230b-0b48-4717-86ba-3b42c1400ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fef2c893-8b2d-4d63-a8fa-d607ba532c2e', 'volume_name': 'volume-fef2c893-8b2d-4d63-a8fa-d607ba532c2e', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (311b9fa4-0ca2-4aeb-986e-92de87ee96e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (311b9fa4-0ca2-4aeb-986e-92de87ee96e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd70b15-69b2-47b2-913f-7f6b2ee464aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:48 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Volume fef2c893-8b2d-4d63-a8fa-d607ba532c2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fef2c893-8b2d-4d63-a8fa-d607ba532c2e', 'volume_size': 1} Jul 08 01:11:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:11:48 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Jul 08 01:11:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b39edc13-0f60-417e-bc9a-ad6558f4ab98 tempest-VolumesActionsTest-1485080785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2" returned: 0 in 1.150s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:11:48 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-b39edc13-0f60-417e-bc9a-ad6558f4ab98 tempest-VolumesActionsTest-1485080785 None] Image conversion details: src /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/conversion/99dce23f-6c80-49ed-858d-bdebbb19cfa2.temp_image.e8f48768-d73e-41b1-9e51-3b84c7972a802euaa7r2.img {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:11:48 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-b39edc13-0f60-417e-bc9a-ad6558f4ab98 tempest-VolumesActionsTest-1485080785 None] Converted 1024.00 MB image at 179.68 MB/s Jul 08 01:11:48 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-b39edc13-0f60-417e-bc9a-ad6558f4ab98 tempest-VolumesActionsTest-1485080785 None] e8f48768-d73e-41b1-9e51-3b84c7972a80 was raw, no need to convert to raw {{(pid=87123) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 08 01:11:51 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:11:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Flow 'volume_create_manager' (b7e0cde3-2df1-4d28-8e93-88fb41c3d455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:11:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ac4290-3a13-4c37-8951-d298e2e7f19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95ac4290-3a13-4c37-8951-d298e2e7f19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-410886817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad1603e3-68f9-4429-a8e7-88ba24515fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035b21f09d8c4b2fb0c1ea5dedb15dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:52Z,use_quota=True,user_id='0dc123fb430f4e068451d77a5eef2b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5824bede-af46-4ef1-ba37-8c88efe1d376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5824bede-af46-4ef1-ba37-8c88efe1d376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74877802-42f1-4896-9319-d10e4a4d54fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74877802-42f1-4896-9319-d10e4a4d54fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad1603e3-68f9-4429-a8e7-88ba24515fe3', 'volume_name': 'volume-ad1603e3-68f9-4429-a8e7-88ba24515fe3', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (804adbd7-2d00-4a44-9c74-3575d0e6b273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (804adbd7-2d00-4a44-9c74-3575d0e6b273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:11:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad459f14-38d7-43f8-ba54-26dd58aa0754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:11:51 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Volume ad1603e3-68f9-4429-a8e7-88ba24515fe3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad1603e3-68f9-4429-a8e7-88ba24515fe3', 'volume_size': 1} Jul 08 01:11:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:01 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=40,cinder:INSERT=15,cinder:UPDATE=54,cinder:DELETE=3 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:12:01 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=36,cinder:UPDATE=48,cinder:INSERT=9,cinder:DELETE=3 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:12:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b39edc13-0f60-417e-bc9a-ad6558f4ab98 tempest-VolumesActionsTest-1485080785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.827s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b39edc13-0f60-417e-bc9a-ad6558f4ab98 tempest-VolumesActionsTest-1485080785 None] Uploaded volume to glance image-id: e8f48768-d73e-41b1-9e51-3b84c7972a80. {{(pid=87123) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 01:12:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 27.909s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1250910783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=135d7113-5491-4133-a86c-8bedc2e2695f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16d68515ec1433cb00c74eab80afec9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:41Z,use_quota=True,user_id='047d63ac8400495dbf81c94f673d86c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:12:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Creating volume 135d7113-5491-4133-a86c-8bedc2e2695f {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:12:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:12:09 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:12:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-135d7113-5491-4133-a86c-8bedc2e2695f 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:09 devstack sudo[98374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-135d7113-5491-4133-a86c-8bedc2e2695f 1073741824 Jul 08 01:12:09 devstack sudo[98374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:09 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b39edc13-0f60-417e-bc9a-ad6558f4ab98 tempest-VolumesActionsTest-1485080785 None] Copy volume to image completed successfully. Jul 08 01:12:10 devstack sudo[98374]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-135d7113-5491-4133-a86c-8bedc2e2695f 1073741824" returned: 0 in 0.921s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-135d7113-5491-4133-a86c-8bedc2e2695f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:10 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-135d7113-5491-4133-a86c-8bedc2e2695f Jul 08 01:12:10 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:11 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-135d7113-5491-4133-a86c-8bedc2e2695f" returned: 0 in 0.744s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:12:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:11:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-341308109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fef2c893-8b2d-4d63-a8fa-d607ba532c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a836033a39b643b2995e2f8d6a399d95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:48Z,use_quota=True,user_id='d62815da100f4cd28fa41b769106c915',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:12:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Creating volume fef2c893-8b2d-4d63-a8fa-d607ba532c2e {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:12:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:12:11 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:12:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fef2c893-8b2d-4d63-a8fa-d607ba532c2e 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b28dad89-49f0-4e02-9dbd-8766cfa080f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-135d7113-5491-4133-a86c-8bedc2e2695f', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:11 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fef2c893-8b2d-4d63-a8fa-d607ba532c2e 1073741824 Jul 08 01:12:11 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a24d50-3632-413d-b5d2-362fb4a061fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:11 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Volume volume-135d7113-5491-4133-a86c-8bedc2e2695f (135d7113-5491-4133-a86c-8bedc2e2695f): created successfully Jul 08 01:12:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27a24d50-3632-413d-b5d2-362fb4a061fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Flow 'volume_create_manager' (50b040f9-b8e2-4883-89c7-c9c33ea2dc4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:11 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-02e4d0fa-2707-4775-9099-ce17ddb223f2 tempest-VolumesTransfersV357Test-68563375 None] Created volume successfully. Jul 08 01:12:11 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3fcd9e4c-305f-416d-84d5-ec3bcda89079 tempest-VolumesTransfersV357Test-411518804 None] Acquiring lock "cinder-135d7113-5491-4133-a86c-8bedc2e2695f-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:11 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3fcd9e4c-305f-416d-84d5-ec3bcda89079 tempest-VolumesTransfersV357Test-411518804 None] Lock "cinder-135d7113-5491-4133-a86c-8bedc2e2695f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3fcd9e4c-305f-416d-84d5-ec3bcda89079 tempest-VolumesTransfersV357Test-411518804 None] Acquiring lock "cinder-quobyte-135d7113-5491-4133-a86c-8bedc2e2695f" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:12 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fef2c893-8b2d-4d63-a8fa-d607ba532c2e 1073741824" returned: 0 in 0.980s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3fcd9e4c-305f-416d-84d5-ec3bcda89079 tempest-VolumesTransfersV357Test-411518804 None] Lock "cinder-quobyte-135d7113-5491-4133-a86c-8bedc2e2695f" acquired by "delete_volume" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4cabb0-804a-4686-a126-318d7b232955]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3fcd9e4c-305f-416d-84d5-ec3bcda89079 tempest-VolumesTransfersV357Test-411518804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-135d7113-5491-4133-a86c-8bedc2e2695f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fef2c893-8b2d-4d63-a8fa-d607ba532c2e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:12 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fef2c893-8b2d-4d63-a8fa-d607ba532c2e Jul 08 01:12:12 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:12 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-135d7113-5491-4133-a86c-8bedc2e2695f Jul 08 01:12:12 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:12 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fef2c893-8b2d-4d63-a8fa-d607ba532c2e" returned: 0 in 0.717s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] <== create_volume: return (1782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.936s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:11:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-410886817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad1603e3-68f9-4429-a8e7-88ba24515fe3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035b21f09d8c4b2fb0c1ea5dedb15dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:11:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:11:52Z,use_quota=True,user_id='0dc123fb430f4e068451d77a5eef2b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Creating volume ad1603e3-68f9-4429-a8e7-88ba24515fe3 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:12:12 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ad1603e3-68f9-4429-a8e7-88ba24515fe3 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:12 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ad1603e3-68f9-4429-a8e7-88ba24515fe3 1073741824 Jul 08 01:12:12 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd70b15-69b2-47b2-913f-7f6b2ee464aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fef2c893-8b2d-4d63-a8fa-d607ba532c2e', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071079fc-52fd-4981-8c42-76d167b5a1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:12 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Volume volume-fef2c893-8b2d-4d63-a8fa-d607ba532c2e (fef2c893-8b2d-4d63-a8fa-d607ba532c2e): created successfully Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (071079fc-52fd-4981-8c42-76d167b5a1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Flow 'volume_create_manager' (512793df-b74e-48b6-babe-4ac58cfff7cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:12 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3fcd9e4c-305f-416d-84d5-ec3bcda89079 tempest-VolumesTransfersV357Test-411518804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-135d7113-5491-4133-a86c-8bedc2e2695f" returned: 0 in 0.896s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3fcd9e4c-305f-416d-84d5-ec3bcda89079 tempest-VolumesTransfersV357Test-411518804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-135d7113-5491-4133-a86c-8bedc2e2695f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:13 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-be814947-a288-4e70-89d8-5d5d9e6fc1a4 tempest-VolumesTransfersV355Test-1741092954 None] Created volume successfully. Jul 08 01:12:13 devstack sudo[98401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-135d7113-5491-4133-a86c-8bedc2e2695f Jul 08 01:12:13 devstack sudo[98401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:13 devstack sudo[98401]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3fcd9e4c-305f-416d-84d5-ec3bcda89079 tempest-VolumesTransfersV357Test-411518804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-135d7113-5491-4133-a86c-8bedc2e2695f" returned: 0 in 0.800s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3fcd9e4c-305f-416d-84d5-ec3bcda89079 tempest-VolumesTransfersV357Test-411518804 None] Lock "cinder-quobyte-135d7113-5491-4133-a86c-8bedc2e2695f" released by "delete_volume" :: held 1.748s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:13 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ad1603e3-68f9-4429-a8e7-88ba24515fe3 1073741824" returned: 0 in 0.997s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:13 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-3fcd9e4c-305f-416d-84d5-ec3bcda89079 tempest-VolumesTransfersV357Test-411518804 None] Created reservations ['b9ca3055-c185-4b4d-99c4-f68408e563a5', '5a563716-0bf6-4ccb-9fa2-59d859234278', '5d413c19-1364-4b6d-b085-5a37535b9bc7', '4c588722-a206-40fe-8d33-980b4acfb3d9'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:12:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ad1603e3-68f9-4429-a8e7-88ba24515fe3 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:13 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ad1603e3-68f9-4429-a8e7-88ba24515fe3 Jul 08 01:12:13 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3fcd9e4c-305f-416d-84d5-ec3bcda89079 tempest-VolumesTransfersV357Test-411518804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3fcd9e4c-305f-416d-84d5-ec3bcda89079 tempest-VolumesTransfersV357Test-411518804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3fcd9e4c-305f-416d-84d5-ec3bcda89079 tempest-VolumesTransfersV357Test-411518804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3fcd9e4c-305f-416d-84d5-ec3bcda89079 tempest-VolumesTransfersV357Test-411518804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3fcd9e4c-305f-416d-84d5-ec3bcda89079 tempest-VolumesTransfersV357Test-411518804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3fcd9e4c-305f-416d-84d5-ec3bcda89079 tempest-VolumesTransfersV357Test-411518804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:14 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:12:14 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ffc12b8c-27bc-4670-b449-6082f4490512 tempest-VolumesTransfersV355Test-2060697669 None] Acquiring lock "cinder-fef2c893-8b2d-4d63-a8fa-d607ba532c2e-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ffc12b8c-27bc-4670-b449-6082f4490512 tempest-VolumesTransfersV355Test-2060697669 None] Lock "cinder-fef2c893-8b2d-4d63-a8fa-d607ba532c2e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ffc12b8c-27bc-4670-b449-6082f4490512 tempest-VolumesTransfersV355Test-2060697669 None] Acquiring lock "cinder-quobyte-fef2c893-8b2d-4d63-a8fa-d607ba532c2e" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ffc12b8c-27bc-4670-b449-6082f4490512 tempest-VolumesTransfersV355Test-2060697669 None] Lock "cinder-quobyte-fef2c893-8b2d-4d63-a8fa-d607ba532c2e" acquired by "delete_volume" :: waited 0.025s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:14 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca5edb32-df8d-4555-b4ce-a67399cdc35d]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ffc12b8c-27bc-4670-b449-6082f4490512 tempest-VolumesTransfersV355Test-2060697669 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fef2c893-8b2d-4d63-a8fa-d607ba532c2e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:14 devstack sudo[98448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fef2c893-8b2d-4d63-a8fa-d607ba532c2e Jul 08 01:12:14 devstack sudo[98448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:14 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3fcd9e4c-305f-416d-84d5-ec3bcda89079 tempest-VolumesTransfersV357Test-411518804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.705s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:14 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-3fcd9e4c-305f-416d-84d5-ec3bcda89079 tempest-VolumesTransfersV357Test-411518804 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:12:14 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-3fcd9e4c-305f-416d-84d5-ec3bcda89079 tempest-VolumesTransfersV357Test-411518804 None] Deleted volume successfully. Jul 08 01:12:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3fcd9e4c-305f-416d-84d5-ec3bcda89079 tempest-VolumesTransfersV357Test-411518804 None] Lock "cinder-135d7113-5491-4133-a86c-8bedc2e2695f-delete_volume" released by "delete_volume" :: held 2.725s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:14 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ad1603e3-68f9-4429-a8e7-88ba24515fe3" returned: 0 in 0.859s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:14 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] <== create_volume: return (1919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:12:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.922s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.889s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:14 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad459f14-38d7-43f8-ba54-26dd58aa0754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad1603e3-68f9-4429-a8e7-88ba24515fe3', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:14 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd277de5-0e1b-408c-af3b-725bb5ba963d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:14 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[93259103-27cc-4fb3-bede-032d624fc2ac]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:14 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Volume volume-ad1603e3-68f9-4429-a8e7-88ba24515fe3 (ad1603e3-68f9-4429-a8e7-88ba24515fe3): created successfully Jul 08 01:12:14 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd277de5-0e1b-408c-af3b-725bb5ba963d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:14 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Flow 'volume_create_manager' (b7e0cde3-2df1-4d28-8e93-88fb41c3d455) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:14 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-536d615d-b4dd-4f5a-af3c-3b8ace506d37 tempest-ProjectReaderTests-120184651 None] Created volume successfully. Jul 08 01:12:14 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 Jul 08 01:12:14 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:15 devstack sudo[98448]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ffc12b8c-27bc-4670-b449-6082f4490512 tempest-VolumesTransfersV355Test-2060697669 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fef2c893-8b2d-4d63-a8fa-d607ba532c2e" returned: 0 in 1.011s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ffc12b8c-27bc-4670-b449-6082f4490512 tempest-VolumesTransfersV355Test-2060697669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fef2c893-8b2d-4d63-a8fa-d607ba532c2e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:15 devstack sudo[98458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fef2c893-8b2d-4d63-a8fa-d607ba532c2e Jul 08 01:12:15 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:15 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2" returned: 0 in 1.040s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:15 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c14c4c02-c449-4938-b08a-66467e2a9259 tempest-ProjectReaderTests-120184651 None] Acquiring lock "cinder-ad1603e3-68f9-4429-a8e7-88ba24515fe3-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:15 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e17dbb8-a0bd-4d3b-b293-804a41241235]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:15 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c14c4c02-c449-4938-b08a-66467e2a9259 tempest-ProjectReaderTests-120184651 None] Lock "cinder-ad1603e3-68f9-4429-a8e7-88ba24515fe3-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:15 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ffc12b8c-27bc-4670-b449-6082f4490512 tempest-VolumesTransfersV355Test-2060697669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-fef2c893-8b2d-4d63-a8fa-d607ba532c2e" returned: 0 in 0.784s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:15 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ffc12b8c-27bc-4670-b449-6082f4490512 tempest-VolumesTransfersV355Test-2060697669 None] Lock "cinder-quobyte-fef2c893-8b2d-4d63-a8fa-d607ba532c2e" released by "delete_volume" :: held 1.860s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c14c4c02-c449-4938-b08a-66467e2a9259 tempest-ProjectReaderTests-120184651 None] Acquiring lock "cinder-quobyte-ad1603e3-68f9-4429-a8e7-88ba24515fe3" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c14c4c02-c449-4938-b08a-66467e2a9259 tempest-ProjectReaderTests-120184651 None] Lock "cinder-quobyte-ad1603e3-68f9-4429-a8e7-88ba24515fe3" acquired by "delete_volume" :: waited 0.040s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:16 devstack sudo[98465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 Jul 08 01:12:16 devstack sudo[98465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:16 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4e3cde8-3387-48a8-a561-905423232de6]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c14c4c02-c449-4938-b08a-66467e2a9259 tempest-ProjectReaderTests-120184651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ad1603e3-68f9-4429-a8e7-88ba24515fe3 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:16 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-ffc12b8c-27bc-4670-b449-6082f4490512 tempest-VolumesTransfersV355Test-2060697669 None] Created reservations ['b1ca516b-ce22-4cad-9140-6ab684a56aa3', '5d07ddf2-0213-4847-a7db-d9336847e5ed', 'a75ca760-2b0b-4062-8f34-5cddbc818f75', '1d97398f-ec46-4c5d-a1ce-2e0050340ab6'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:12:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ffc12b8c-27bc-4670-b449-6082f4490512 tempest-VolumesTransfersV355Test-2060697669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ffc12b8c-27bc-4670-b449-6082f4490512 tempest-VolumesTransfersV355Test-2060697669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ffc12b8c-27bc-4670-b449-6082f4490512 tempest-VolumesTransfersV355Test-2060697669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ffc12b8c-27bc-4670-b449-6082f4490512 tempest-VolumesTransfersV355Test-2060697669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ffc12b8c-27bc-4670-b449-6082f4490512 tempest-VolumesTransfersV355Test-2060697669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ffc12b8c-27bc-4670-b449-6082f4490512 tempest-VolumesTransfersV355Test-2060697669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:16 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ad1603e3-68f9-4429-a8e7-88ba24515fe3 Jul 08 01:12:16 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:16 devstack sudo[98469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:12:16 devstack sudo[98469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:17 devstack sudo[98465]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2" returned: 0 in 1.508s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 /opt/stack/data/cinder/conversion/99dce23f-6c80-49ed-858d-bdebbb19cfa2.temp_image.58af16f0-912b-485f-b23a-f4f099a4361212seqo22.img {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:17 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 /opt/stack/data/cinder/conversion/99dce23f-6c80-49ed-858d-bdebbb19cfa2.temp_image.58af16f0-912b-485f-b23a-f4f099a4361212seqo22.img Jul 08 01:12:17 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:17 devstack sudo[98469]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ffc12b8c-27bc-4670-b449-6082f4490512 tempest-VolumesTransfersV355Test-2060697669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.250s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:17 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-ffc12b8c-27bc-4670-b449-6082f4490512 tempest-VolumesTransfersV355Test-2060697669 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:12:17 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-ffc12b8c-27bc-4670-b449-6082f4490512 tempest-VolumesTransfersV355Test-2060697669 None] Deleted volume successfully. Jul 08 01:12:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ffc12b8c-27bc-4670-b449-6082f4490512 tempest-VolumesTransfersV355Test-2060697669 None] Lock "cinder-fef2c893-8b2d-4d63-a8fa-d607ba532c2e-delete_volume" released by "delete_volume" :: held 3.654s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:17 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c14c4c02-c449-4938-b08a-66467e2a9259 tempest-ProjectReaderTests-120184651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ad1603e3-68f9-4429-a8e7-88ba24515fe3" returned: 0 in 1.715s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c14c4c02-c449-4938-b08a-66467e2a9259 tempest-ProjectReaderTests-120184651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ad1603e3-68f9-4429-a8e7-88ba24515fe3 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:17 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ad1603e3-68f9-4429-a8e7-88ba24515fe3 Jul 08 01:12:17 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:19 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c14c4c02-c449-4938-b08a-66467e2a9259 tempest-ProjectReaderTests-120184651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-ad1603e3-68f9-4429-a8e7-88ba24515fe3" returned: 0 in 1.270s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:19 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c14c4c02-c449-4938-b08a-66467e2a9259 tempest-ProjectReaderTests-120184651 None] Lock "cinder-quobyte-ad1603e3-68f9-4429-a8e7-88ba24515fe3" released by "delete_volume" :: held 3.079s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:19 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-c14c4c02-c449-4938-b08a-66467e2a9259 tempest-ProjectReaderTests-120184651 None] Created reservations ['02ee0acd-b68d-415a-946f-55fc9477f4c5', 'df1854df-2180-472b-ad0a-411219d39a56', '767db215-9632-46ba-9397-ed58d8b78b2c', 'f8dda5f5-cf95-45f1-a9b2-f2a934f82208'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:12:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c14c4c02-c449-4938-b08a-66467e2a9259 tempest-ProjectReaderTests-120184651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c14c4c02-c449-4938-b08a-66467e2a9259 tempest-ProjectReaderTests-120184651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c14c4c02-c449-4938-b08a-66467e2a9259 tempest-ProjectReaderTests-120184651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c14c4c02-c449-4938-b08a-66467e2a9259 tempest-ProjectReaderTests-120184651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c14c4c02-c449-4938-b08a-66467e2a9259 tempest-ProjectReaderTests-120184651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c14c4c02-c449-4938-b08a-66467e2a9259 tempest-ProjectReaderTests-120184651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:19 devstack sudo[98494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:12:19 devstack sudo[98494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:21 devstack sudo[98494]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c14c4c02-c449-4938-b08a-66467e2a9259 tempest-ProjectReaderTests-120184651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 2.059s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:21 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-c14c4c02-c449-4938-b08a-66467e2a9259 tempest-ProjectReaderTests-120184651 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:12:21 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-c14c4c02-c449-4938-b08a-66467e2a9259 tempest-ProjectReaderTests-120184651 None] Deleted volume successfully. Jul 08 01:12:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c14c4c02-c449-4938-b08a-66467e2a9259 tempest-ProjectReaderTests-120184651 None] Lock "cinder-ad1603e3-68f9-4429-a8e7-88ba24515fe3-delete_volume" released by "delete_volume" :: held 5.996s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:22 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:12:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Flow 'volume_create_manager' (b8ca0573-a6dc-4346-b040-d46ee6dbfcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d6130d-c372-4886-ac8e-2ac8a58c97f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57d6130d-c372-4886-ac8e-2ac8a58c97f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1372295657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b573a281-9651-4a4d-a272-9dd1e1acd917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035b21f09d8c4b2fb0c1ea5dedb15dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:22Z,use_quota=True,user_id='0dc123fb430f4e068451d77a5eef2b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (204935ae-606b-4f64-bf94-b23d5f52b915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (204935ae-606b-4f64-bf94-b23d5f52b915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dda027a-c36f-4e0b-aa70-187bfa587634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dda027a-c36f-4e0b-aa70-187bfa587634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b573a281-9651-4a4d-a272-9dd1e1acd917', 'volume_name': 'volume-b573a281-9651-4a4d-a272-9dd1e1acd917', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb672046-cd90-4a8a-a77b-226c1ab71663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb672046-cd90-4a8a-a77b-226c1ab71663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d436a0c-c601-4a26-b728-bd84a5b8836a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:22 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Volume b573a281-9651-4a4d-a272-9dd1e1acd917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b573a281-9651-4a4d-a272-9dd1e1acd917', 'volume_size': 1} Jul 08 01:12:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:24 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 /opt/stack/data/cinder/conversion/99dce23f-6c80-49ed-858d-bdebbb19cfa2.temp_image.58af16f0-912b-485f-b23a-f4f099a4361212seqo22.img" returned: 0 in 7.488s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:24 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[58407344-6b6d-494f-b07e-7f52f7361577]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:25 devstack sudo[98504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 Jul 08 01:12:25 devstack sudo[98504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:26 devstack sudo[98504]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2" returned: 0 in 1.189s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:26 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] Image conversion details: src /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2, size 1024.00 MB, duration 7.49 sec, destination /opt/stack/data/cinder/conversion/99dce23f-6c80-49ed-858d-bdebbb19cfa2.temp_image.58af16f0-912b-485f-b23a-f4f099a4361212seqo22.img {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:12:26 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] Converted 1024.00 MB image at 136.73 MB/s Jul 08 01:12:26 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] 58af16f0-912b-485f-b23a-f4f099a43612 was raw, converting to qcow2 {{(pid=87123) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 08 01:12:26 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06ec932-9566-4e7d-bd3d-9c7031e1bad8]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/99dce23f-6c80-49ed-858d-bdebbb19cfa2.temp_image.58af16f0-912b-485f-b23a-f4f099a4361212seqo22.img {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:26 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/99dce23f-6c80-49ed-858d-bdebbb19cfa2.temp_image.58af16f0-912b-485f-b23a-f4f099a4361212seqo22.img Jul 08 01:12:26 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:26 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:12:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Flow 'volume_create_manager' (6d701ad0-e6f4-40ae-99a3-342007ff26c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a336caf5-62bd-41c5-94b9-5cf19de65a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a336caf5-62bd-41c5-94b9-5cf19de65a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2125524137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e694cb162a4df4ac264a1f271530e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:27Z,use_quota=True,user_id='e4e476a1c2ca44aabea19167519af27d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79242805-aded-4eda-9ef4-5a3c404be176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79242805-aded-4eda-9ef4-5a3c404be176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77e60bb-ce2c-42e5-8704-37ca70126010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c77e60bb-ce2c-42e5-8704-37ca70126010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba', 'volume_name': 'volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09383061-a39a-4475-885a-5c4718f453f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (09383061-a39a-4475-885a-5c4718f453f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a6280f-551e-4475-8a50-75085ebc1d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:26 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Volume 5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba', 'volume_size': 1} Jul 08 01:12:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:27 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/99dce23f-6c80-49ed-858d-bdebbb19cfa2.temp_image.58af16f0-912b-485f-b23a-f4f099a4361212seqo22.img" returned: 0 in 0.941s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/99dce23f-6c80-49ed-858d-bdebbb19cfa2.temp_image.58af16f0-912b-485f-b23a-f4f099a4361212seqo22.img {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:27 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/99dce23f-6c80-49ed-858d-bdebbb19cfa2.temp_image.58af16f0-912b-485f-b23a-f4f099a4361212seqo22.img Jul 08 01:12:27 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:28 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/99dce23f-6c80-49ed-858d-bdebbb19cfa2.temp_image.58af16f0-912b-485f-b23a-f4f099a4361212seqo22.img" returned: 1 in 0.913s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/99dce23f-6c80-49ed-858d-bdebbb19cfa2.temp_image.58af16f0-912b-485f-b23a-f4f099a4361212seqo22.img' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:12:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/99dce23f-6c80-49ed-858d-bdebbb19cfa2.temp_image.58af16f0-912b-485f-b23a-f4f099a4361212seqo22.img /opt/stack/data/cinder/conversion/vol_upload_zo2gdrcx {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:28 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/99dce23f-6c80-49ed-858d-bdebbb19cfa2.temp_image.58af16f0-912b-485f-b23a-f4f099a4361212seqo22.img /opt/stack/data/cinder/conversion/vol_upload_zo2gdrcx Jul 08 01:12:28 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:28 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:12:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Flow 'volume_create_manager' (53ae49ee-45b5-49ad-8b48-add246ef3cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d865ab-2853-46b8-9fbd-8566e58f3477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d865ab-2853-46b8-9fbd-8566e58f3477) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2138469663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a1bf98-4975-4ba5-9779-2a11df2f9bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5dad4a03f71400db13e8e3bc9f5215f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:28Z,use_quota=True,user_id='87d6f266213a4a36ad3f371b6f9d034e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98986ae5-73da-46bc-9a92-21684586565f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98986ae5-73da-46bc-9a92-21684586565f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61d63c1-1af5-417a-bac3-f3f52251d881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a61d63c1-1af5-417a-bac3-f3f52251d881) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4a1bf98-4975-4ba5-9779-2a11df2f9bb8', 'volume_name': 'volume-d4a1bf98-4975-4ba5-9779-2a11df2f9bb8', 'volume_size': 2}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf1b638-3ed8-4054-9529-33cd467a6282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf1b638-3ed8-4054-9529-33cd467a6282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f57f202-f920-4095-a8e4-b741ff46eb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:28 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Volume d4a1bf98-4975-4ba5-9779-2a11df2f9bb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4a1bf98-4975-4ba5-9779-2a11df2f9bb8', 'volume_size': 2} Jul 08 01:12:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:28 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/99dce23f-6c80-49ed-858d-bdebbb19cfa2.temp_image.58af16f0-912b-485f-b23a-f4f099a4361212seqo22.img /opt/stack/data/cinder/conversion/vol_upload_zo2gdrcx" returned: 0 in 0.772s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:28 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] Image conversion details: src /opt/stack/data/cinder/conversion/99dce23f-6c80-49ed-858d-bdebbb19cfa2.temp_image.58af16f0-912b-485f-b23a-f4f099a4361212seqo22.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_zo2gdrcx {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:12:28 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 08 01:12:28 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4dd7ef-07b4-46b0-96fc-5f702c4e44c0]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zo2gdrcx {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:28 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zo2gdrcx Jul 08 01:12:28 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:29 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zo2gdrcx" returned: 0 in 0.803s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 16.394s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] Uploaded volume to glance image-id: 58af16f0-912b-485f-b23a-f4f099a43612. {{(pid=87123) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 08 01:12:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.427s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1372295657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b573a281-9651-4a4d-a272-9dd1e1acd917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035b21f09d8c4b2fb0c1ea5dedb15dc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:22Z,use_quota=True,user_id='0dc123fb430f4e068451d77a5eef2b0e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:12:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Creating volume b573a281-9651-4a4d-a272-9dd1e1acd917 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:12:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:12:31 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:12:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b573a281-9651-4a4d-a272-9dd1e1acd917 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:31 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b573a281-9651-4a4d-a272-9dd1e1acd917 1073741824 Jul 08 01:12:31 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:31 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-41106d23-9529-4f49-bb03-b6a830edc82a tempest-VolumesActionsTest-1485080785 None] Copy volume to image completed successfully. Jul 08 01:12:32 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b573a281-9651-4a4d-a272-9dd1e1acd917 1073741824" returned: 0 in 0.975s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b573a281-9651-4a4d-a272-9dd1e1acd917 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:32 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b573a281-9651-4a4d-a272-9dd1e1acd917 Jul 08 01:12:32 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fe25a8d8-1f56-4ae1-abba-24f045745442 tempest-VolumesActionsTest-1485080785 None] Acquiring lock "cinder-99dce23f-6c80-49ed-858d-bdebbb19cfa2-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:33 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b573a281-9651-4a4d-a272-9dd1e1acd917" returned: 0 in 0.833s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] <== create_volume: return (1862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.866s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fe25a8d8-1f56-4ae1-abba-24f045745442 tempest-VolumesActionsTest-1485080785 None] Lock "cinder-99dce23f-6c80-49ed-858d-bdebbb19cfa2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.262s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2125524137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e694cb162a4df4ac264a1f271530e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:27Z,use_quota=True,user_id='e4e476a1c2ca44aabea19167519af27d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Creating volume 5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:12:33 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:33 devstack sudo[98539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba 1073741824 Jul 08 01:12:33 devstack sudo[98539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d436a0c-c601-4a26-b728-bd84a5b8836a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b573a281-9651-4a4d-a272-9dd1e1acd917', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33372b33-4a07-4eba-8149-0c73cc90eae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:33 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Volume volume-b573a281-9651-4a4d-a272-9dd1e1acd917 (b573a281-9651-4a4d-a272-9dd1e1acd917): created successfully Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33372b33-4a07-4eba-8149-0c73cc90eae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Flow 'volume_create_manager' (b8ca0573-a6dc-4346-b040-d46ee6dbfcd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fe25a8d8-1f56-4ae1-abba-24f045745442 tempest-VolumesActionsTest-1485080785 None] Acquiring lock "cinder-quobyte-99dce23f-6c80-49ed-858d-bdebbb19cfa2" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:33 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-c3544389-7e5e-41c1-8d9f-ab95737f3bb4 tempest-ProjectReaderTests-120184651 None] Created volume successfully. Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fe25a8d8-1f56-4ae1-abba-24f045745442 tempest-VolumesActionsTest-1485080785 None] Lock "cinder-quobyte-99dce23f-6c80-49ed-858d-bdebbb19cfa2" acquired by "delete_volume" :: waited 0.033s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83bd078-ad36-4548-ad5b-c4e6fcf04f92]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fe25a8d8-1f56-4ae1-abba-24f045745442 tempest-VolumesActionsTest-1485080785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:33 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 Jul 08 01:12:33 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:34 devstack sudo[98539]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba 1073741824" returned: 0 in 1.020s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:34 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fe25a8d8-1f56-4ae1-abba-24f045745442 tempest-VolumesActionsTest-1485080785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2" returned: 0 in 0.844s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fe25a8d8-1f56-4ae1-abba-24f045745442 tempest-VolumesActionsTest-1485080785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:34 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2 Jul 08 01:12:34 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:34 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba Jul 08 01:12:34 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-755fa0b8-f637-435e-b07c-9c3a68fde1c6 tempest-ProjectReaderTests-120184651 None] Acquiring lock "cinder-b573a281-9651-4a4d-a272-9dd1e1acd917-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-755fa0b8-f637-435e-b07c-9c3a68fde1c6 tempest-ProjectReaderTests-120184651 None] Lock "cinder-b573a281-9651-4a4d-a272-9dd1e1acd917-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-755fa0b8-f637-435e-b07c-9c3a68fde1c6 tempest-ProjectReaderTests-120184651 None] Acquiring lock "cinder-quobyte-b573a281-9651-4a4d-a272-9dd1e1acd917" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-755fa0b8-f637-435e-b07c-9c3a68fde1c6 tempest-ProjectReaderTests-120184651 None] Lock "cinder-quobyte-b573a281-9651-4a4d-a272-9dd1e1acd917" acquired by "delete_volume" :: waited 0.029s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20e2827-e1a0-4e70-8ca3-3099f9d9b126]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-755fa0b8-f637-435e-b07c-9c3a68fde1c6 tempest-ProjectReaderTests-120184651 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b573a281-9651-4a4d-a272-9dd1e1acd917 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:34 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b573a281-9651-4a4d-a272-9dd1e1acd917 Jul 08 01:12:34 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:34 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fe25a8d8-1f56-4ae1-abba-24f045745442 tempest-VolumesActionsTest-1485080785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-99dce23f-6c80-49ed-858d-bdebbb19cfa2" returned: 0 in 0.728s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fe25a8d8-1f56-4ae1-abba-24f045745442 tempest-VolumesActionsTest-1485080785 None] Lock "cinder-quobyte-99dce23f-6c80-49ed-858d-bdebbb19cfa2" released by "delete_volume" :: held 1.625s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:34 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba" returned: 0 in 0.741s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.837s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.560s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2138469663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4a1bf98-4975-4ba5-9779-2a11df2f9bb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5dad4a03f71400db13e8e3bc9f5215f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:28Z,use_quota=True,user_id='87d6f266213a4a36ad3f371b6f9d034e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Creating volume d4a1bf98-4975-4ba5-9779-2a11df2f9bb8 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:12:34 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d4a1bf98-4975-4ba5-9779-2a11df2f9bb8 2147483648 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62a6280f-551e-4475-8a50-75085ebc1d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:34 devstack sudo[98558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d4a1bf98-4975-4ba5-9779-2a11df2f9bb8 2147483648 Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc3874c-4f4a-473c-beb3-43daf9d0d4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:34 devstack sudo[98558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:34 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Volume volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba (5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba): created successfully Jul 08 01:12:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc3874c-4f4a-473c-beb3-43daf9d0d4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Flow 'volume_create_manager' (6d701ad0-e6f4-40ae-99a3-342007ff26c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:35 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-39c8edaf-9086-4a10-a21f-8ad5163fb105 tempest-VolumesCloneTest-1912533478 None] Created volume successfully. Jul 08 01:12:35 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-fe25a8d8-1f56-4ae1-abba-24f045745442 tempest-VolumesActionsTest-1485080785 None] Created reservations ['8aaf070f-89d4-48a9-b637-737f4cb71854', '924ce3e8-08f9-401f-964c-3c15190faa37', '02cd5d8f-0a7f-41e5-81c9-b6d56c97596b', 'b9bcab31-d7ee-44e9-b226-2dbd5bcecd88'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:12:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fe25a8d8-1f56-4ae1-abba-24f045745442 tempest-VolumesActionsTest-1485080785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fe25a8d8-1f56-4ae1-abba-24f045745442 tempest-VolumesActionsTest-1485080785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-fe25a8d8-1f56-4ae1-abba-24f045745442 tempest-VolumesActionsTest-1485080785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-fe25a8d8-1f56-4ae1-abba-24f045745442 tempest-VolumesActionsTest-1485080785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fe25a8d8-1f56-4ae1-abba-24f045745442 tempest-VolumesActionsTest-1485080785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fe25a8d8-1f56-4ae1-abba-24f045745442 tempest-VolumesActionsTest-1485080785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:35 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:12:35 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:35 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-755fa0b8-f637-435e-b07c-9c3a68fde1c6 tempest-ProjectReaderTests-120184651 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b573a281-9651-4a4d-a272-9dd1e1acd917" returned: 0 in 1.101s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-755fa0b8-f637-435e-b07c-9c3a68fde1c6 tempest-ProjectReaderTests-120184651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b573a281-9651-4a4d-a272-9dd1e1acd917 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:35 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b573a281-9651-4a4d-a272-9dd1e1acd917 Jul 08 01:12:35 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:12:36 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fe25a8d8-1f56-4ae1-abba-24f045745442 tempest-VolumesActionsTest-1485080785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.944s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-fe25a8d8-1f56-4ae1-abba-24f045745442 tempest-VolumesActionsTest-1485080785 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:12:36 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-fe25a8d8-1f56-4ae1-abba-24f045745442 tempest-VolumesActionsTest-1485080785 None] Deleted volume successfully. Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Flow 'volume_create_manager' (b3329421-d76c-4eb5-aab8-444cecf0b39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416875e1-146a-4bfb-9827-f90e34211583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (416875e1-146a-4bfb-9827-f90e34211583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-347962766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e49cbe34-a8d7-41c4-aee4-9be99b61f0c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08e694cb162a4df4ac264a1f271530e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:36Z,use_quota=True,user_id='e4e476a1c2ca44aabea19167519af27d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d66820e-1333-4310-ad98-40cfefea1c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d66820e-1333-4310-ad98-40cfefea1c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d08c75-31a1-4068-b9dd-93c50aa6de63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d08c75-31a1-4068-b9dd-93c50aa6de63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e49cbe34-a8d7-41c4-aee4-9be99b61f0c8', 'volume_name': 'volume-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8', 'volume_size': 2, 'source_volid': '5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba', 'source_volstatus': 'available'}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f6f350a-a0de-45f6-9bbc-0fc9b1726c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f6f350a-a0de-45f6-9bbc-0fc9b1726c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6e0007-d7ed-49ce-98d7-9850890d0e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:36 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Volume e49cbe34-a8d7-41c4-aee4-9be99b61f0c8: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8', 'volume_size': 2, 'source_volid': '5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba', 'source_volstatus': 'available'} Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fe25a8d8-1f56-4ae1-abba-24f045745442 tempest-VolumesActionsTest-1485080785 None] Lock "cinder-99dce23f-6c80-49ed-858d-bdebbb19cfa2-delete_volume" released by "delete_volume" :: held 3.166s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:36 devstack sudo[98558]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d4a1bf98-4975-4ba5-9779-2a11df2f9bb8 2147483648" returned: 0 in 1.377s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d4a1bf98-4975-4ba5-9779-2a11df2f9bb8 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:36 devstack sudo[98572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d4a1bf98-4975-4ba5-9779-2a11df2f9bb8 Jul 08 01:12:36 devstack sudo[98572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:36 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-755fa0b8-f637-435e-b07c-9c3a68fde1c6 tempest-ProjectReaderTests-120184651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b573a281-9651-4a4d-a272-9dd1e1acd917" returned: 0 in 1.065s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-755fa0b8-f637-435e-b07c-9c3a68fde1c6 tempest-ProjectReaderTests-120184651 None] Lock "cinder-quobyte-b573a281-9651-4a4d-a272-9dd1e1acd917" released by "delete_volume" :: held 2.221s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-755fa0b8-f637-435e-b07c-9c3a68fde1c6 tempest-ProjectReaderTests-120184651 None] Created reservations ['5e5b22bc-6488-47db-83b1-abcd9e8ee9a3', '987e7f2a-2e6d-4a30-b6b4-828c080a19d0', '792d578a-8c78-42af-a704-b825e4291f48', '31688a79-571f-4263-a521-82b2a9258d31'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-755fa0b8-f637-435e-b07c-9c3a68fde1c6 tempest-ProjectReaderTests-120184651 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-755fa0b8-f637-435e-b07c-9c3a68fde1c6 tempest-ProjectReaderTests-120184651 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-755fa0b8-f637-435e-b07c-9c3a68fde1c6 tempest-ProjectReaderTests-120184651 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-755fa0b8-f637-435e-b07c-9c3a68fde1c6 tempest-ProjectReaderTests-120184651 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-755fa0b8-f637-435e-b07c-9c3a68fde1c6 tempest-ProjectReaderTests-120184651 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-755fa0b8-f637-435e-b07c-9c3a68fde1c6 tempest-ProjectReaderTests-120184651 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:36 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:12:36 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:37 devstack sudo[98572]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d4a1bf98-4975-4ba5-9779-2a11df2f9bb8" returned: 0 in 0.863s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] <== create_volume: return (2296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:12:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.303s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.980s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:37 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Cloning volume 5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba to volume e49cbe34-a8d7-41c4-aee4-9be99b61f0c8 Jul 08 01:12:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Creating offline snapshot 4e09d217-6e13-445a-99a8-79679134b945 of volume 5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:12:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f57f202-f920-4095-a8e4-b741ff46eb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4a1bf98-4975-4ba5-9779-2a11df2f9bb8', 'volume_size': 2}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5824cf63-9061-400e-a9eb-eb3dfd59eb31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:37 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[f23856cf-1976-4ba6-bd89-a42c34a66f2e]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:37 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Volume volume-d4a1bf98-4975-4ba5-9779-2a11df2f9bb8 (d4a1bf98-4975-4ba5-9779-2a11df2f9bb8): created successfully Jul 08 01:12:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5824cf63-9061-400e-a9eb-eb3dfd59eb31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Flow 'volume_create_manager' (53ae49ee-45b5-49ad-8b48-add246ef3cd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:37 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-36c98e7c-7b16-457b-905b-1b3aa512ba4e tempest-VolumesCloneNegativeTest-2125901257 None] Created volume successfully. Jul 08 01:12:37 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba Jul 08 01:12:37 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:37 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-755fa0b8-f637-435e-b07c-9c3a68fde1c6 tempest-ProjectReaderTests-120184651 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.906s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:37 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-755fa0b8-f637-435e-b07c-9c3a68fde1c6 tempest-ProjectReaderTests-120184651 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:12:37 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-755fa0b8-f637-435e-b07c-9c3a68fde1c6 tempest-ProjectReaderTests-120184651 None] Deleted volume successfully. Jul 08 01:12:37 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-755fa0b8-f637-435e-b07c-9c3a68fde1c6 tempest-ProjectReaderTests-120184651 None] Lock "cinder-b573a281-9651-4a4d-a272-9dd1e1acd917-delete_volume" released by "delete_volume" :: held 3.438s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e295e0ee-e6b6-41d9-a275-03f6d508b626 tempest-VolumesCloneNegativeTest-2125901257 None] Acquiring lock "cinder-d4a1bf98-4975-4ba5-9779-2a11df2f9bb8-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e295e0ee-e6b6-41d9-a275-03f6d508b626 tempest-VolumesCloneNegativeTest-2125901257 None] Lock "cinder-d4a1bf98-4975-4ba5-9779-2a11df2f9bb8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e295e0ee-e6b6-41d9-a275-03f6d508b626 tempest-VolumesCloneNegativeTest-2125901257 None] Acquiring lock "cinder-quobyte-d4a1bf98-4975-4ba5-9779-2a11df2f9bb8" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e295e0ee-e6b6-41d9-a275-03f6d508b626 tempest-VolumesCloneNegativeTest-2125901257 None] Lock "cinder-quobyte-d4a1bf98-4975-4ba5-9779-2a11df2f9bb8" acquired by "delete_volume" :: waited 0.051s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:38 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d016858-1189-453f-81ae-b3d35ca11089]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e295e0ee-e6b6-41d9-a275-03f6d508b626 tempest-VolumesCloneNegativeTest-2125901257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d4a1bf98-4975-4ba5-9779-2a11df2f9bb8 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:38 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba" returned: 0 in 1.171s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:38 devstack sudo[98586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945 1G Jul 08 01:12:38 devstack sudo[98586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:38 devstack sudo[98585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d4a1bf98-4975-4ba5-9779-2a11df2f9bb8 Jul 08 01:12:38 devstack sudo[98585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:39 devstack sudo[98585]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e295e0ee-e6b6-41d9-a275-03f6d508b626 tempest-VolumesCloneNegativeTest-2125901257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d4a1bf98-4975-4ba5-9779-2a11df2f9bb8" returned: 0 in 1.383s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e295e0ee-e6b6-41d9-a275-03f6d508b626 tempest-VolumesCloneNegativeTest-2125901257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d4a1bf98-4975-4ba5-9779-2a11df2f9bb8 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:39 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d4a1bf98-4975-4ba5-9779-2a11df2f9bb8 Jul 08 01:12:39 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:39 devstack sudo[98586]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945 1G" returned: 0 in 1.462s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:39 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945 Jul 08 01:12:39 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:40 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e295e0ee-e6b6-41d9-a275-03f6d508b626 tempest-VolumesCloneNegativeTest-2125901257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d4a1bf98-4975-4ba5-9779-2a11df2f9bb8" returned: 0 in 0.942s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e295e0ee-e6b6-41d9-a275-03f6d508b626 tempest-VolumesCloneNegativeTest-2125901257 None] Lock "cinder-quobyte-d4a1bf98-4975-4ba5-9779-2a11df2f9bb8" released by "delete_volume" :: held 2.397s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:40 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-e295e0ee-e6b6-41d9-a275-03f6d508b626 tempest-VolumesCloneNegativeTest-2125901257 None] Created reservations ['eda5e71f-3c25-4b6a-ab04-56899f8b3194', 'c817e1ed-93b6-4530-a3f0-6de4ec08f636', '2a4f2dc4-0a1e-4ab0-a824-cec2a5008bd1', '2530bbc1-a5fe-4052-b42d-75f9aff12277'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:12:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e295e0ee-e6b6-41d9-a275-03f6d508b626 tempest-VolumesCloneNegativeTest-2125901257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e295e0ee-e6b6-41d9-a275-03f6d508b626 tempest-VolumesCloneNegativeTest-2125901257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e295e0ee-e6b6-41d9-a275-03f6d508b626 tempest-VolumesCloneNegativeTest-2125901257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e295e0ee-e6b6-41d9-a275-03f6d508b626 tempest-VolumesCloneNegativeTest-2125901257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e295e0ee-e6b6-41d9-a275-03f6d508b626 tempest-VolumesCloneNegativeTest-2125901257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e295e0ee-e6b6-41d9-a275-03f6d508b626 tempest-VolumesCloneNegativeTest-2125901257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:40 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:12:40 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:41 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945" returned: 0 in 1.217s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:41 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945 is being set with open permissions: ugo+rw Jul 08 01:12:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:41 devstack sudo[98610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945 Jul 08 01:12:41 devstack sudo[98610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:41 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e295e0ee-e6b6-41d9-a275-03f6d508b626 tempest-VolumesCloneNegativeTest-2125901257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.753s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:41 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-e295e0ee-e6b6-41d9-a275-03f6d508b626 tempest-VolumesCloneNegativeTest-2125901257 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:12:41 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-e295e0ee-e6b6-41d9-a275-03f6d508b626 tempest-VolumesCloneNegativeTest-2125901257 None] Deleted volume successfully. Jul 08 01:12:41 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e295e0ee-e6b6-41d9-a275-03f6d508b626 tempest-VolumesCloneNegativeTest-2125901257 None] Lock "cinder-d4a1bf98-4975-4ba5-9779-2a11df2f9bb8-delete_volume" released by "delete_volume" :: held 3.520s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:41 devstack sudo[98610]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945" returned: 0 in 0.824s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:42 devstack sudo[98614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.info Jul 08 01:12:42 devstack sudo[98614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:42 devstack sudo[98614]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.info" returned: 0 in 0.860s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:42 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.info is being set with open permissions: ugo+rw Jul 08 01:12:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:42 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.info Jul 08 01:12:42 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:43 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.info" returned: 0 in 0.792s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Acquiring lock "cinder-quobyte-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8" by "_copy_volume_from_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Lock "cinder-quobyte-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] snapshot: 4e09d217-6e13-445a-99a8-79679134b945, volume: e49cbe34-a8d7-41c4-aee4-9be99b61f0c8, {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:12:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:43 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[b957c806-ec4e-455b-8dbb-ba15a0b46092]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:43 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945 Jul 08 01:12:43 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:44 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945" returned: 0 in 1.056s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:12:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:12:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Creating direct copy from snapshot {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:12:44 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e1e23d-1ac0-4c4d-93d4-4873a7881b98]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:12:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:44 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:12:44 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:45 devstack sudo[98627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba Jul 08 01:12:45 devstack sudo[98627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:45 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:12:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Flow 'volume_create_manager' (aec2ccf2-d654-41b3-9511-5626db0b3231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8290605b-4ed4-482e-bbea-d37bfc839d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8290605b-4ed4-482e-bbea-d37bfc839d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2016610547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8157fc8f-962f-4d13-8069-89140a7e3729,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7a6f26dc7b994b93b6971961999c2024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:45Z,use_quota=True,user_id='d00eed277f2645bcb23874586fa7058a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43502fd4-4d3c-4366-b994-807a1e63ebdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43502fd4-4d3c-4366-b994-807a1e63ebdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeae81f9-51b8-46d3-8147-9a5e42b8122e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eeae81f9-51b8-46d3-8147-9a5e42b8122e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8157fc8f-962f-4d13-8069-89140a7e3729', 'volume_name': 'volume-8157fc8f-962f-4d13-8069-89140a7e3729', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ad2bf9-1975-4e3e-97a6-484be9ddac4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20ad2bf9-1975-4e3e-97a6-484be9ddac4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e876fb9a-09ad-477c-abb2-d710147ff9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:45 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Volume 8157fc8f-962f-4d13-8069-89140a7e3729: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8157fc8f-962f-4d13-8069-89140a7e3729', 'volume_size': 1} Jul 08 01:12:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:45 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.993s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:45 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:12:45 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:12:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 28 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:12:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:12:45 devstack sudo[98627]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba" returned: 0 in 1.064s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:45 devstack cinder-volume[87123]: DEBUG cinder.utils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Path /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8 not found in is_blk_device check {{(pid=87123) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:12:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:45 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8 Jul 08 01:12:45 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:46 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:12:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Flow 'volume_create_manager' (59dbce0c-f50f-4034-900a-23c791e49486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c689fc2-bc3c-4365-9a5d-e48634e64f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c689fc2-bc3c-4365-9a5d-e48634e64f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1554074326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04470f96-0e59-40fc-9370-553d6b40463a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ff05060998411080dccc8d81e3e970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:47Z,use_quota=True,user_id='cebfd957b2a04584976028787d00123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab550b0-c3ca-4e65-b659-66c105ff366a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cab550b0-c3ca-4e65-b659-66c105ff366a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc42e91-918b-4730-924b-3d66cae119e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cc42e91-918b-4730-924b-3d66cae119e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04470f96-0e59-40fc-9370-553d6b40463a', 'volume_name': 'volume-04470f96-0e59-40fc-9370-553d6b40463a', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07bd1e08-0539-4206-a144-900865aa7c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07bd1e08-0539-4206-a144-900865aa7c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667e2f74-31ba-49da-ad06-d3bc7e18579c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:46 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Volume 04470f96-0e59-40fc-9370-553d6b40463a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04470f96-0e59-40fc-9370-553d6b40463a', 'volume_size': 1} Jul 08 01:12:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:50 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8" returned: 0 in 4.689s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:50 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d803f5e2-73fa-41e1-ae12-e75dc63aa227]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:50 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba Jul 08 01:12:50 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:51 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba" returned: 0 in 0.979s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:51 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Image conversion details: src /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba, size 1024.00 MB, duration 4.69 sec, destination /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8 {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:12:51 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Converted 1024.00 MB image at 218.37 MB/s Jul 08 01:12:51 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8 is being set with open permissions: ugo+rw Jul 08 01:12:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:51 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8 Jul 08 01:12:51 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:52 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8" returned: 0 in 0.653s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Lock "cinder-quobyte-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8" released by "_copy_volume_from_snapshot" :: held 8.568s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Acquiring lock "cinder-quobyte-4e09d217-6e13-445a-99a8-79679134b945" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Lock "cinder-quobyte-4e09d217-6e13-445a-99a8-79679134b945" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Deleting offline snapshot 4e09d217-6e13-445a-99a8-79679134b945 of volume 5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:12:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] snapshot_file for this snap is: volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:12:52 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce93dbc1-3f96-4318-93c5-a72a159e6ea9]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:52 devstack sudo[98657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945 Jul 08 01:12:52 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:53 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945" returned: 0 in 0.827s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:53 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:12:53 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d72f7e75-6cd0-4add-9264-3b56eed52ae5]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:53 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba Jul 08 01:12:53 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:54 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba" returned: 0 in 0.752s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:54 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945 Jul 08 01:12:54 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:55 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945" returned: 0 in 0.684s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:55 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945 Jul 08 01:12:55 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:55 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba.4e09d217-6e13-445a-99a8-79679134b945" returned: 0 in 0.625s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Lock "cinder-quobyte-4e09d217-6e13-445a-99a8-79679134b945" released by "_delete_snapshot" :: held 2.979s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.415s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.300s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2016610547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8157fc8f-962f-4d13-8069-89140a7e3729,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7a6f26dc7b994b93b6971961999c2024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:45Z,use_quota=True,user_id='d00eed277f2645bcb23874586fa7058a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:12:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Creating volume 8157fc8f-962f-4d13-8069-89140a7e3729 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:12:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:12:56 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:12:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8157fc8f-962f-4d13-8069-89140a7e3729 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a6e0007-d7ed-49ce-98d7-9850890d0e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8', 'volume_size': 2, 'source_volid': '5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba', 'source_volstatus': 'available'}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee84855-d462-4675-8ace-04bc091df940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:56 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8157fc8f-962f-4d13-8069-89140a7e3729 1073741824 Jul 08 01:12:56 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:56 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Volume volume-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8 (e49cbe34-a8d7-41c4-aee4-9be99b61f0c8): created successfully Jul 08 01:12:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ee84855-d462-4675-8ace-04bc091df940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Flow 'volume_create_manager' (b3329421-d76c-4eb5-aab8-444cecf0b39f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:56 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-708defe1-0fe9-4be0-aac7-dde2634148c9 tempest-VolumesCloneTest-1912533478 None] Created volume successfully. Jul 08 01:12:57 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8157fc8f-962f-4d13-8069-89140a7e3729 1073741824" returned: 0 in 0.940s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8157fc8f-962f-4d13-8069-89140a7e3729 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:57 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8157fc8f-962f-4d13-8069-89140a7e3729 Jul 08 01:12:57 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1fc6ad96-a757-48a2-ae1e-1f9d62304c24 tempest-VolumesCloneTest-1912533478 None] Acquiring lock "cinder-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1fc6ad96-a757-48a2-ae1e-1f9d62304c24 tempest-VolumesCloneTest-1912533478 None] Lock "cinder-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1fc6ad96-a757-48a2-ae1e-1f9d62304c24 tempest-VolumesCloneTest-1912533478 None] Acquiring lock "cinder-quobyte-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:12:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1fc6ad96-a757-48a2-ae1e-1f9d62304c24 tempest-VolumesCloneTest-1912533478 None] Lock "cinder-quobyte-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8" acquired by "delete_volume" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:12:58 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0996fdc2-f267-43a6-8e8e-46e7fef71c83]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:12:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1fc6ad96-a757-48a2-ae1e-1f9d62304c24 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:58 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8 Jul 08 01:12:58 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:58 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8157fc8f-962f-4d13-8069-89140a7e3729" returned: 0 in 0.749s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:12:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.751s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.558s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1554074326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04470f96-0e59-40fc-9370-553d6b40463a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ff05060998411080dccc8d81e3e970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:12:47Z,use_quota=True,user_id='cebfd957b2a04584976028787d00123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:12:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Creating volume 04470f96-0e59-40fc-9370-553d6b40463a {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:12:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:12:58 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:12:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:58 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e876fb9a-09ad-477c-abb2-d710147ff9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8157fc8f-962f-4d13-8069-89140a7e3729', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:58 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a 1073741824 Jul 08 01:12:58 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:58 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b7c1bf-8fe6-4101-b333-321c34609bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:12:58 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Volume volume-8157fc8f-962f-4d13-8069-89140a7e3729 (8157fc8f-962f-4d13-8069-89140a7e3729): created successfully Jul 08 01:12:58 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30b7c1bf-8fe6-4101-b333-321c34609bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:12:58 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Flow 'volume_create_manager' (aec2ccf2-d654-41b3-9511-5626db0b3231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:12:58 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-4a9d4a31-62fe-4299-9bd2-29571e979f2f tempest-VolumesGetTest-1383156073 None] Created volume successfully. Jul 08 01:12:58 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1fc6ad96-a757-48a2-ae1e-1f9d62304c24 tempest-VolumesCloneTest-1912533478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8" returned: 0 in 0.894s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1fc6ad96-a757-48a2-ae1e-1f9d62304c24 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:58 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8 Jul 08 01:12:58 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:59 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a 1073741824" returned: 0 in 1.051s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:59 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a Jul 08 01:12:59 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:12:59 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Jul 08 01:12:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1fc6ad96-a757-48a2-ae1e-1f9d62304c24 tempest-VolumesCloneTest-1912533478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8" returned: 0 in 0.767s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:12:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1fc6ad96-a757-48a2-ae1e-1f9d62304c24 tempest-VolumesCloneTest-1912533478 None] Lock "cinder-quobyte-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8" released by "delete_volume" :: held 1.730s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:12:59 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-1fc6ad96-a757-48a2-ae1e-1f9d62304c24 tempest-VolumesCloneTest-1912533478 None] Created reservations ['b079cc6c-5f8c-449c-9536-ca3bce89ca07', '3a562e2b-c1ea-4d36-9e2e-968ecbb56c23', '17283841-99a0-431d-ad94-2320da74b079', '15b2df30-81b7-4abb-a72a-f335efd1ab5c'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:12:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1fc6ad96-a757-48a2-ae1e-1f9d62304c24 tempest-VolumesCloneTest-1912533478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:12:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1fc6ad96-a757-48a2-ae1e-1f9d62304c24 tempest-VolumesCloneTest-1912533478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:12:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1fc6ad96-a757-48a2-ae1e-1f9d62304c24 tempest-VolumesCloneTest-1912533478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:12:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1fc6ad96-a757-48a2-ae1e-1f9d62304c24 tempest-VolumesCloneTest-1912533478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:12:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1fc6ad96-a757-48a2-ae1e-1f9d62304c24 tempest-VolumesCloneTest-1912533478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:12:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1fc6ad96-a757-48a2-ae1e-1f9d62304c24 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:12:59 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:12:59 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Flow 'volume_create_manager' (08c9409a-91f1-4f4e-8a27-7727d3cfaedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6f58c90-86ab-4420-a862-beb561e267f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6f58c90-86ab-4420-a862-beb561e267f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-610240809',display_name='tempest-VolumesGetTest-Volume-493094900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9de53f6-3cfc-49f0-a2a2-1af43dd73d86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6f26dc7b994b93b6971961999c2024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:00Z,use_quota=True,user_id='d00eed277f2645bcb23874586fa7058a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d9050f-1ef0-4891-9d0b-fe1789af2f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d9050f-1ef0-4891-9d0b-fe1789af2f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4bdb21a-160b-426c-b77b-cfcc48943523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4bdb21a-160b-426c-b77b-cfcc48943523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9de53f6-3cfc-49f0-a2a2-1af43dd73d86', 'volume_name': 'volume-a9de53f6-3cfc-49f0-a2a2-1af43dd73d86', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f6c99f9-645e-44bb-87e0-ecd4b319382c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f6c99f9-645e-44bb-87e0-ecd4b319382c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf7c7d2-44ab-47a4-8786-bdda56161623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:00 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Volume a9de53f6-3cfc-49f0-a2a2-1af43dd73d86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9de53f6-3cfc-49f0-a2a2-1af43dd73d86', 'volume_size': 1} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-56159bcc-73fc-41b6-9c8a-7db93d6add92 tempest-VolumesCloneTest-1912533478 None] Acquiring lock "cinder-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:00 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-56159bcc-73fc-41b6-9c8a-7db93d6add92 tempest-VolumesCloneTest-1912533478 None] Lock "cinder-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a" returned: 0 in 0.786s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.907s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.055s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:00Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-610240809',display_name='tempest-VolumesGetTest-Volume-493094900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9de53f6-3cfc-49f0-a2a2-1af43dd73d86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6f26dc7b994b93b6971961999c2024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:00Z,use_quota=True,user_id='d00eed277f2645bcb23874586fa7058a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Creating volume a9de53f6-3cfc-49f0-a2a2-1af43dd73d86 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:13:00 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a9de53f6-3cfc-49f0-a2a2-1af43dd73d86 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:00 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a9de53f6-3cfc-49f0-a2a2-1af43dd73d86 1073741824 Jul 08 01:13:00 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (667e2f74-31ba-49da-ad06-d3bc7e18579c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04470f96-0e59-40fc-9370-553d6b40463a', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89baffe9-bc08-4093-bc24-c6c41d8639fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:00 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Volume volume-04470f96-0e59-40fc-9370-553d6b40463a (04470f96-0e59-40fc-9370-553d6b40463a): created successfully Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89baffe9-bc08-4093-bc24-c6c41d8639fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Flow 'volume_create_manager' (59dbce0c-f50f-4034-900a-23c791e49486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-56159bcc-73fc-41b6-9c8a-7db93d6add92 tempest-VolumesCloneTest-1912533478 None] Acquiring lock "cinder-quobyte-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:00 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-21e15074-df36-4eef-9560-1c894f41533d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Created volume successfully. Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-56159bcc-73fc-41b6-9c8a-7db93d6add92 tempest-VolumesCloneTest-1912533478 None] Lock "cinder-quobyte-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba" acquired by "delete_volume" :: waited 0.028s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[5828b757-6884-44fe-a235-d1ea02e57e46]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-56159bcc-73fc-41b6-9c8a-7db93d6add92 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:00 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba Jul 08 01:13:00 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:00 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1fc6ad96-a757-48a2-ae1e-1f9d62304c24 tempest-VolumesCloneTest-1912533478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.898s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-1fc6ad96-a757-48a2-ae1e-1f9d62304c24 tempest-VolumesCloneTest-1912533478 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:00 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-1fc6ad96-a757-48a2-ae1e-1f9d62304c24 tempest-VolumesCloneTest-1912533478 None] Deleted volume successfully. Jul 08 01:13:00 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1fc6ad96-a757-48a2-ae1e-1f9d62304c24 tempest-VolumesCloneTest-1912533478 None] Lock "cinder-e49cbe34-a8d7-41c4-aee4-9be99b61f0c8-delete_volume" released by "delete_volume" :: held 2.936s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-68d4d52a-ac8f-4cb3-98ad-fcaaaf2c22ad tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:01 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a9de53f6-3cfc-49f0-a2a2-1af43dd73d86 1073741824" returned: 0 in 1.067s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a9de53f6-3cfc-49f0-a2a2-1af43dd73d86 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:01 devstack sudo[98716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a9de53f6-3cfc-49f0-a2a2-1af43dd73d86 Jul 08 01:13:01 devstack sudo[98716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:01 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-56159bcc-73fc-41b6-9c8a-7db93d6add92 tempest-VolumesCloneTest-1912533478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba" returned: 0 in 1.035s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-56159bcc-73fc-41b6-9c8a-7db93d6add92 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:01 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba Jul 08 01:13:01 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:02 devstack sudo[98716]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:02 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-56159bcc-73fc-41b6-9c8a-7db93d6add92 tempest-VolumesCloneTest-1912533478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba" returned: 0 in 0.750s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a9de53f6-3cfc-49f0-a2a2-1af43dd73d86" returned: 0 in 0.863s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] <== create_volume: return (1998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:13:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-68d4d52a-ac8f-4cb3-98ad-fcaaaf2c22ad tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.202s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-56159bcc-73fc-41b6-9c8a-7db93d6add92 tempest-VolumesCloneTest-1912533478 None] Lock "cinder-quobyte-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba" released by "delete_volume" :: held 1.879s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf7c7d2-44ab-47a4-8786-bdda56161623) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9de53f6-3cfc-49f0-a2a2-1af43dd73d86', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e532b46-083b-44cf-85e5-cb3eb3485b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-68d4d52a-ac8f-4cb3-98ad-fcaaaf2c22ad tempest-CreateVolumesFromSnapshotTest-1516322981 None] Creating offline snapshot fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f of volume 04470f96-0e59-40fc-9370-553d6b40463a {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:13:02 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Volume volume-a9de53f6-3cfc-49f0-a2a2-1af43dd73d86 (a9de53f6-3cfc-49f0-a2a2-1af43dd73d86): created successfully Jul 08 01:13:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e532b46-083b-44cf-85e5-cb3eb3485b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Flow 'volume_create_manager' (08c9409a-91f1-4f4e-8a27-7727d3cfaedf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:02 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01739fc-a9f4-400e-9822-cfe5d29a4057]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68d4d52a-ac8f-4cb3-98ad-fcaaaf2c22ad tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:02 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-99238415-34e2-47e1-8fe3-3c4d194cbbdf tempest-VolumesGetTest-1383156073 None] Created volume successfully. Jul 08 01:13:02 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=58,cinder:UPDATE=93,cinder:DELETE=9,cinder:INSERT=24 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:13:02 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:UPDATE=84,cinder:SELECT=67,cinder:INSERT=18,cinder:DELETE=8 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:13:02 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-56159bcc-73fc-41b6-9c8a-7db93d6add92 tempest-VolumesCloneTest-1912533478 None] Created reservations ['0148b9e3-83be-4e32-92e6-c6a7c415a863', '0e91e554-0c20-4c97-bf11-30a455c5b1ad', '24249f1e-69d8-4eed-9302-44d77b0b49e0', '268e1ca3-44fb-45d7-8edf-fbdfceeecbb9'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:02 devstack sudo[98722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a Jul 08 01:13:02 devstack sudo[98722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-56159bcc-73fc-41b6-9c8a-7db93d6add92 tempest-VolumesCloneTest-1912533478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-56159bcc-73fc-41b6-9c8a-7db93d6add92 tempest-VolumesCloneTest-1912533478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-56159bcc-73fc-41b6-9c8a-7db93d6add92 tempest-VolumesCloneTest-1912533478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-56159bcc-73fc-41b6-9c8a-7db93d6add92 tempest-VolumesCloneTest-1912533478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-56159bcc-73fc-41b6-9c8a-7db93d6add92 tempest-VolumesCloneTest-1912533478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-56159bcc-73fc-41b6-9c8a-7db93d6add92 tempest-VolumesCloneTest-1912533478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:02 devstack sudo[98724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:13:02 devstack sudo[98724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:03 devstack sudo[98724]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-56159bcc-73fc-41b6-9c8a-7db93d6add92 tempest-VolumesCloneTest-1912533478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.790s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:03 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-56159bcc-73fc-41b6-9c8a-7db93d6add92 tempest-VolumesCloneTest-1912533478 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:03 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-56159bcc-73fc-41b6-9c8a-7db93d6add92 tempest-VolumesCloneTest-1912533478 None] Deleted volume successfully. Jul 08 01:13:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-56159bcc-73fc-41b6-9c8a-7db93d6add92 tempest-VolumesCloneTest-1912533478 None] Lock "cinder-5cd3af5c-857a-4d1c-8660-e1ed4c4bdbba-delete_volume" released by "delete_volume" :: held 3.131s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66cb921c-249e-4988-b397-257807e685fc tempest-VolumesGetTest-1383156073 None] Acquiring lock "cinder-a9de53f6-3cfc-49f0-a2a2-1af43dd73d86-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66cb921c-249e-4988-b397-257807e685fc tempest-VolumesGetTest-1383156073 None] Lock "cinder-a9de53f6-3cfc-49f0-a2a2-1af43dd73d86-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:03 devstack sudo[98722]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68d4d52a-ac8f-4cb3-98ad-fcaaaf2c22ad tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a" returned: 0 in 1.124s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68d4d52a-ac8f-4cb3-98ad-fcaaaf2c22ad tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66cb921c-249e-4988-b397-257807e685fc tempest-VolumesGetTest-1383156073 None] Acquiring lock "cinder-quobyte-a9de53f6-3cfc-49f0-a2a2-1af43dd73d86" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:03 devstack sudo[98731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f 1G Jul 08 01:13:03 devstack sudo[98731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66cb921c-249e-4988-b397-257807e685fc tempest-VolumesGetTest-1383156073 None] Lock "cinder-quobyte-a9de53f6-3cfc-49f0-a2a2-1af43dd73d86" acquired by "delete_volume" :: waited 0.026s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:03 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[672f5d48-5bcb-434f-90e4-900060e4bc5d]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66cb921c-249e-4988-b397-257807e685fc tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a9de53f6-3cfc-49f0-a2a2-1af43dd73d86 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:03 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a9de53f6-3cfc-49f0-a2a2-1af43dd73d86 Jul 08 01:13:03 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:04 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66cb921c-249e-4988-b397-257807e685fc tempest-VolumesGetTest-1383156073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a9de53f6-3cfc-49f0-a2a2-1af43dd73d86" returned: 0 in 1.034s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66cb921c-249e-4988-b397-257807e685fc tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a9de53f6-3cfc-49f0-a2a2-1af43dd73d86 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:04 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a9de53f6-3cfc-49f0-a2a2-1af43dd73d86 Jul 08 01:13:04 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:04 devstack sudo[98731]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68d4d52a-ac8f-4cb3-98ad-fcaaaf2c22ad tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f 1G" returned: 0 in 1.217s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68d4d52a-ac8f-4cb3-98ad-fcaaaf2c22ad tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04470f96-0e59-40fc-9370-553d6b40463a -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:04 devstack sudo[98745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04470f96-0e59-40fc-9370-553d6b40463a -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f Jul 08 01:13:04 devstack sudo[98745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:05 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66cb921c-249e-4988-b397-257807e685fc tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a9de53f6-3cfc-49f0-a2a2-1af43dd73d86" returned: 0 in 1.044s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:05 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66cb921c-249e-4988-b397-257807e685fc tempest-VolumesGetTest-1383156073 None] Lock "cinder-quobyte-a9de53f6-3cfc-49f0-a2a2-1af43dd73d86" released by "delete_volume" :: held 2.156s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:05 devstack sudo[98745]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68d4d52a-ac8f-4cb3-98ad-fcaaaf2c22ad tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-04470f96-0e59-40fc-9370-553d6b40463a -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f" returned: 0 in 1.030s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:05 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-68d4d52a-ac8f-4cb3-98ad-fcaaaf2c22ad tempest-CreateVolumesFromSnapshotTest-1516322981 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f is being set with open permissions: ugo+rw Jul 08 01:13:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68d4d52a-ac8f-4cb3-98ad-fcaaaf2c22ad tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:05 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f Jul 08 01:13:05 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:05 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-66cb921c-249e-4988-b397-257807e685fc tempest-VolumesGetTest-1383156073 None] Created reservations ['31198546-210a-4e9a-ac05-64eb9be8dd7a', '28c7c378-640a-4287-88ac-7a26a68cf5bb', 'e27e8379-84db-4f33-8855-fb16ca8718e4', '8525e77a-f06d-46c2-a792-3582981b83d4'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-66cb921c-249e-4988-b397-257807e685fc tempest-VolumesGetTest-1383156073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-66cb921c-249e-4988-b397-257807e685fc tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:05 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-66cb921c-249e-4988-b397-257807e685fc tempest-VolumesGetTest-1383156073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:05 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-66cb921c-249e-4988-b397-257807e685fc tempest-VolumesGetTest-1383156073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-66cb921c-249e-4988-b397-257807e685fc tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66cb921c-249e-4988-b397-257807e685fc tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:05 devstack sudo[98755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:13:05 devstack sudo[98755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:06 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68d4d52a-ac8f-4cb3-98ad-fcaaaf2c22ad tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f" returned: 0 in 0.851s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:06 devstack sudo[98755]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68d4d52a-ac8f-4cb3-98ad-fcaaaf2c22ad tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66cb921c-249e-4988-b397-257807e685fc tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.759s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:06 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-66cb921c-249e-4988-b397-257807e685fc tempest-VolumesGetTest-1383156073 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:06 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-66cb921c-249e-4988-b397-257807e685fc tempest-VolumesGetTest-1383156073 None] Deleted volume successfully. Jul 08 01:13:06 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.info Jul 08 01:13:06 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:06 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66cb921c-249e-4988-b397-257807e685fc tempest-VolumesGetTest-1383156073 None] Lock "cinder-a9de53f6-3cfc-49f0-a2a2-1af43dd73d86-delete_volume" released by "delete_volume" :: held 3.269s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:06 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d16accad-9208-43e0-8879-9ff2351a94c6 tempest-VolumesGetTest-1383156073 None] Acquiring lock "cinder-8157fc8f-962f-4d13-8069-89140a7e3729-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:06 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d16accad-9208-43e0-8879-9ff2351a94c6 tempest-VolumesGetTest-1383156073 None] Lock "cinder-8157fc8f-962f-4d13-8069-89140a7e3729-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d16accad-9208-43e0-8879-9ff2351a94c6 tempest-VolumesGetTest-1383156073 None] Acquiring lock "cinder-quobyte-8157fc8f-962f-4d13-8069-89140a7e3729" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d16accad-9208-43e0-8879-9ff2351a94c6 tempest-VolumesGetTest-1383156073 None] Lock "cinder-quobyte-8157fc8f-962f-4d13-8069-89140a7e3729" acquired by "delete_volume" :: waited 0.014s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:07 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ae7831-1e18-49ae-8bbb-b6b5c20ea6aa]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d16accad-9208-43e0-8879-9ff2351a94c6 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8157fc8f-962f-4d13-8069-89140a7e3729 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:07 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8157fc8f-962f-4d13-8069-89140a7e3729 Jul 08 01:13:07 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:07 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68d4d52a-ac8f-4cb3-98ad-fcaaaf2c22ad tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.info" returned: 0 in 0.825s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:07 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-68d4d52a-ac8f-4cb3-98ad-fcaaaf2c22ad tempest-CreateVolumesFromSnapshotTest-1516322981 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.info is being set with open permissions: ugo+rw Jul 08 01:13:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68d4d52a-ac8f-4cb3-98ad-fcaaaf2c22ad tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:07 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.info Jul 08 01:13:07 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:08 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d16accad-9208-43e0-8879-9ff2351a94c6 tempest-VolumesGetTest-1383156073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8157fc8f-962f-4d13-8069-89140a7e3729" returned: 0 in 1.006s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d16accad-9208-43e0-8879-9ff2351a94c6 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8157fc8f-962f-4d13-8069-89140a7e3729 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:08 devstack sudo[98769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8157fc8f-962f-4d13-8069-89140a7e3729 Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:13:08 devstack sudo[98769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Flow 'volume_create_manager' (771a0b4e-94f9-47d9-b1d1-d4387c4a4f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5714ebcc-c9ea-468f-a8e6-36b53bfc3ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5714ebcc-c9ea-468f-a8e6-36b53bfc3ccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-800606969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e5cb7f-1986-456e-a9f4-062ab29ad0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0bec86bef44a918bea26a9acae1350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:08Z,use_quota=True,user_id='cea1ed406bb64f1dbee53d406f9ec32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0db2cda-d38f-4b1d-b58f-537b984e2087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0db2cda-d38f-4b1d-b58f-537b984e2087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8d85ea-d3a1-4925-a021-9319d3c8a83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG cinder.image.glance [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Creating Keystone auth plugin from conf {{(pid=87123) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:13:08 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68d4d52a-ac8f-4cb3-98ad-fcaaaf2c22ad tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.info" returned: 0 in 0.778s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-68d4d52a-ac8f-4cb3-98ad-fcaaaf2c22ad tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.015s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:08 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-68d4d52a-ac8f-4cb3-98ad-fcaaaf2c22ad tempest-CreateVolumesFromSnapshotTest-1516322981 None] Create snapshot completed successfully Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f8d85ea-d3a1-4925-a021-9319d3c8a83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '63e5cb7f-1986-456e-a9f4-062ab29ad0eb', 'volume_name': 'volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb', 'volume_size': 1, 'image_id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '464063acafa44f9e90fd1bca62b64e8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'created_at': datetime.datetime(2026, 7, 7, 22, 51, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 51, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b737ac-37ee-466d-b3cd-f8e0bc471da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33b737ac-37ee-466d-b3cd-f8e0bc471da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d02ac86-4e85-4868-8ab5-8b1ed812e497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:08 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Volume 63e5cb7f-1986-456e-a9f4-062ab29ad0eb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb', 'volume_size': 1, 'image_id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '464063acafa44f9e90fd1bca62b64e8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'created_at': datetime.datetime(2026, 7, 7, 22, 51, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 51, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Trying to clone 63e5cb7f-1986-456e-a9f4-062ab29ad0eb from image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d at location (None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}]). {{(pid=87123) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_dbkgbxvydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:13:08 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Image download 20.69 MB at 20.69 MB/s Jul 08 01:13:08 devstack sudo[98769]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d16accad-9208-43e0-8879-9ff2351a94c6 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8157fc8f-962f-4d13-8069-89140a7e3729" returned: 0 in 0.771s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d16accad-9208-43e0-8879-9ff2351a94c6 tempest-VolumesGetTest-1383156073 None] Lock "cinder-quobyte-8157fc8f-962f-4d13-8069-89140a7e3729" released by "delete_volume" :: held 1.828s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8e50ca-83b5-4449-a526-7f22a42a6390]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_dbkgbxvydevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:08 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-d16accad-9208-43e0-8879-9ff2351a94c6 tempest-VolumesGetTest-1383156073 None] Created reservations ['827dc5fa-893a-4023-b00e-2cb62fb5d41e', '67ddeceb-49d9-45aa-8999-7be523682717', '060674c7-7404-4f14-9749-8c7638bea30d', '5c4d3a38-1780-4669-aa07-0cb3b5c4dc88'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:08 devstack sudo[98774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_dbkgbxvydevstack@QuobyteHD Jul 08 01:13:08 devstack sudo[98774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d16accad-9208-43e0-8879-9ff2351a94c6 tempest-VolumesGetTest-1383156073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d16accad-9208-43e0-8879-9ff2351a94c6 tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d16accad-9208-43e0-8879-9ff2351a94c6 tempest-VolumesGetTest-1383156073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d16accad-9208-43e0-8879-9ff2351a94c6 tempest-VolumesGetTest-1383156073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d16accad-9208-43e0-8879-9ff2351a94c6 tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d16accad-9208-43e0-8879-9ff2351a94c6 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:09 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:13:09 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:13:09 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Flow 'volume_create_manager' (55e5ec3f-7d0b-4cd8-a45a-bec5966faf58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37984507-936c-4546-8aea-e36e47f9ce64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d16accad-9208-43e0-8879-9ff2351a94c6 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.775s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-d16accad-9208-43e0-8879-9ff2351a94c6 tempest-VolumesGetTest-1383156073 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37984507-936c-4546-8aea-e36e47f9ce64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1279701328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f96fa0-9248-438b-a18f-a177a92619b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6f26dc7b994b93b6971961999c2024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:10Z,use_quota=True,user_id='d00eed277f2645bcb23874586fa7058a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322b8ba2-ab23-47f7-8afa-b8e127383403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:09 devstack sudo[98774]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (322b8ba2-ab23-47f7-8afa-b8e127383403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8808ab9-c8ed-4851-abd8-62925795f4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8808ab9-c8ed-4851-abd8-62925795f4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13f96fa0-9248-438b-a18f-a177a92619b2', 'volume_name': 'volume-13f96fa0-9248-438b-a18f-a177a92619b2', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e26dbd-9e4d-4a9c-b57b-2fc0fe466b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06e26dbd-9e4d-4a9c-b57b-2fc0fe466b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91926a6c-ef6d-4589-a000-27671a089947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:09 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Volume 13f96fa0-9248-438b-a18f-a177a92619b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13f96fa0-9248-438b-a18f-a177a92619b2', 'volume_size': 1} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1279701328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13f96fa0-9248-438b-a18f-a177a92619b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6f26dc7b994b93b6971961999c2024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:10Z,use_quota=True,user_id='d00eed277f2645bcb23874586fa7058a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Creating volume 13f96fa0-9248-438b-a18f-a177a92619b2 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:13:09 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:09 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-d16accad-9208-43e0-8879-9ff2351a94c6 tempest-VolumesGetTest-1383156073 None] Deleted volume successfully. Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_dbkgbxvydevstack@QuobyteHD" returned: 0 in 1.029s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Temporary image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d is fetched for user cea1ed406bb64f1dbee53d406f9ec32e. {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:13:09 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2 1073741824 Jul 08 01:13:09 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d16accad-9208-43e0-8879-9ff2351a94c6 tempest-VolumesGetTest-1383156073 None] Lock "cinder-8157fc8f-962f-4d13-8069-89140a7e3729-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f96afd2-b749-4aa6-9948-6dc516074c60]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_dbkgbxvydevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:13:10 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_dbkgbxvydevstack@QuobyteHD Jul 08 01:13:10 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Flow 'volume_create_manager' (206e981c-dd74-488f-a3c8-ec85307497b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99256e48-2d53-4174-a830-1c70eecfa7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99256e48-2d53-4174-a830-1c70eecfa7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1834492970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1941e6d9-0cae-44d4-9874-c477d0cf6b53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ff05060998411080dccc8d81e3e970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:10Z,use_quota=True,user_id='cebfd957b2a04584976028787d00123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c19fde24-ff40-4eb9-a5e6-404a8987796b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c19fde24-ff40-4eb9-a5e6-404a8987796b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (516ecbb0-3933-4fd6-91c3-31aa20fb6e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (516ecbb0-3933-4fd6-91c3-31aa20fb6e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1941e6d9-0cae-44d4-9874-c477d0cf6b53', 'volume_name': 'volume-1941e6d9-0cae-44d4-9874-c477d0cf6b53', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145b6856-358c-409c-8393-4a3da8963c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (145b6856-358c-409c-8393-4a3da8963c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de22eb3-583c-4a26-b85e-2dbd6032c910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:10 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Volume 1941e6d9-0cae-44d4-9874-c477d0cf6b53: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1941e6d9-0cae-44d4-9874-c477d0cf6b53', 'volume_size': 1} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Flow 'volume_create_manager' (94b73a41-215d-40f2-a166-17c64373bfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5956c77-6ac6-4382-ba9a-2a166ef11f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5956c77-6ac6-4382-ba9a-2a166ef11f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-459653587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c4d254-6c3b-4d78-ac10-299443e09ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ff05060998411080dccc8d81e3e970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:11Z,use_quota=True,user_id='cebfd957b2a04584976028787d00123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90083c5e-be08-4e68-b290-18ce49d94846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90083c5e-be08-4e68-b290-18ce49d94846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a96825e-4045-4951-a1c6-54f2fc18d544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a96825e-4045-4951-a1c6-54f2fc18d544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38c4d254-6c3b-4d78-ac10-299443e09ea4', 'volume_name': 'volume-38c4d254-6c3b-4d78-ac10-299443e09ea4', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b19f682c-1554-439c-bb47-0949532d2367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b19f682c-1554-439c-bb47-0949532d2367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (657cb365-a951-4a52-8c7f-29b2ece8c333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:10 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Volume 38c4d254-6c3b-4d78-ac10-299443e09ea4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38c4d254-6c3b-4d78-ac10-299443e09ea4', 'volume_size': 1} Jul 08 01:13:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:11 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_dbkgbxvydevstack@QuobyteHD" returned: 0 in 0.968s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:11 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2 1073741824" returned: 0 in 1.207s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Flow 'volume_create_manager' (7c3eef8f-e3da-4a67-95b3-34d554fc53bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde5b850-0b2b-4053-b6d9-90f2425fbbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cde5b850-0b2b-4053-b6d9-90f2425fbbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-989839266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57847b78-0915-41b6-a9a3-774fb8e50d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ff05060998411080dccc8d81e3e970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:11Z,use_quota=True,user_id='cebfd957b2a04584976028787d00123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0b0fe0-ba66-45a7-b52e-b4521342cd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd0b0fe0-ba66-45a7-b52e-b4521342cd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5646aca7-4d1e-4239-8406-261d587cf687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5646aca7-4d1e-4239-8406-261d587cf687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57847b78-0915-41b6-a9a3-774fb8e50d63', 'volume_name': 'volume-57847b78-0915-41b6-a9a3-774fb8e50d63', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bcdef84-fd8c-462d-941f-4fe38605a1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bcdef84-fd8c-462d-941f-4fe38605a1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43185697-616c-4a34-805a-f44731a01f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:11 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Volume 57847b78-0915-41b6-a9a3-774fb8e50d63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57847b78-0915-41b6-a9a3-774fb8e50d63', 'volume_size': 1} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:11 devstack sudo[98795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2 Jul 08 01:13:11 devstack sudo[98795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Flow 'volume_create_manager' (3b62abc8-d7d9-4be7-96e0-71f8e92cbbfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e58566-6d76-4c2d-af41-8545ea311ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e58566-6d76-4c2d-af41-8545ea311ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-854107232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d4252b0-5ec3-410f-b18c-447f6cfe75f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ff05060998411080dccc8d81e3e970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:11Z,use_quota=True,user_id='cebfd957b2a04584976028787d00123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c7182e-c95e-42dd-93c9-1b0f936e2dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70c7182e-c95e-42dd-93c9-1b0f936e2dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33aaa61e-c1c5-4726-b7b6-8dace1137570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33aaa61e-c1c5-4726-b7b6-8dace1137570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d4252b0-5ec3-410f-b18c-447f6cfe75f5', 'volume_name': 'volume-6d4252b0-5ec3-410f-b18c-447f6cfe75f5', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7096f677-d882-4cfd-bff5-ed02e93d6134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7096f677-d882-4cfd-bff5-ed02e93d6134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ea4f52-338f-4228-ae4d-163a32dbbf86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:11 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Volume 6d4252b0-5ec3-410f-b18c-447f6cfe75f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d4252b0-5ec3-410f-b18c-447f6cfe75f5', 'volume_size': 1} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:13:11 devstack sudo[98795]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Flow 'volume_create_manager' (0b856547-dce3-4ec3-bae0-6185b621e21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45333786-59ba-4de4-8659-57eb8202e433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2" returned: 0 in 0.774s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] <== create_volume: return (2116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.118s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.725s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1834492970',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1941e6d9-0cae-44d4-9874-c477d0cf6b53,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ff05060998411080dccc8d81e3e970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:10Z,use_quota=True,user_id='cebfd957b2a04584976028787d00123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Creating volume 1941e6d9-0cae-44d4-9874-c477d0cf6b53 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:13:12 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:13:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1941e6d9-0cae-44d4-9874-c477d0cf6b53 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45333786-59ba-4de4-8659-57eb8202e433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-389299961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=614986e0-9527-4e67-9131-881899eeb0a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ff05060998411080dccc8d81e3e970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:12Z,use_quota=True,user_id='cebfd957b2a04584976028787d00123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:12 devstack sudo[98798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1941e6d9-0cae-44d4-9874-c477d0cf6b53 1073741824 Jul 08 01:13:12 devstack sudo[98798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af80c8b8-efd1-4299-bcf7-667bdb6fe669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af80c8b8-efd1-4299-bcf7-667bdb6fe669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52c2aed2-ddf7-4f9d-bcf5-f7f4c4868985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52c2aed2-ddf7-4f9d-bcf5-f7f4c4868985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '614986e0-9527-4e67-9131-881899eeb0a6', 'volume_name': 'volume-614986e0-9527-4e67-9131-881899eeb0a6', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc0331f-343e-401a-bb90-07053d3dcad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc0331f-343e-401a-bb90-07053d3dcad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454c2f63-5f53-44b8-8e38-aa4fde90af08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:12 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Volume 614986e0-9527-4e67-9131-881899eeb0a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-614986e0-9527-4e67-9131-881899eeb0a6', 'volume_size': 1} Jul 08 01:13:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91926a6c-ef6d-4589-a000-27671a089947) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13f96fa0-9248-438b-a18f-a177a92619b2', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd7b35a-b2a6-4730-8228-bd86c89a37bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:12 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Volume volume-13f96fa0-9248-438b-a18f-a177a92619b2 (13f96fa0-9248-438b-a18f-a177a92619b2): created successfully Jul 08 01:13:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dd7b35a-b2a6-4730-8228-bd86c89a37bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Flow 'volume_create_manager' (55e5ec3f-7d0b-4cd8-a45a-bec5966faf58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:12 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-c0cc5a78-07d0-4325-83a7-68fcd48266c6 tempest-VolumesGetTest-1383156073 None] Created volume successfully. Jul 08 01:13:12 devstack sudo[98798]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1941e6d9-0cae-44d4-9874-c477d0cf6b53 1073741824" returned: 0 in 0.904s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1941e6d9-0cae-44d4-9874-c477d0cf6b53 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:12 devstack sudo[98804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1941e6d9-0cae-44d4-9874-c477d0cf6b53 Jul 08 01:13:12 devstack sudo[98804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Flow 'volume_create_manager' (a889d9f3-fd21-4ef7-9067-b15e6b7c73b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f9a1a9-16b8-42dc-9667-023ffcb0803f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15f9a1a9-16b8-42dc-9667-023ffcb0803f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-305976352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7056d27-e545-4e58-ace6-812c5f137846,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7a6f26dc7b994b93b6971961999c2024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=13f96fa0-9248-438b-a18f-a177a92619b2,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:14Z,use_quota=True,user_id='d00eed277f2645bcb23874586fa7058a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b9d099-5eb2-4037-9299-ef70f4e8feb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1b9d099-5eb2-4037-9299-ef70f4e8feb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:13 devstack sudo[98804]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eedd8f5d-d29d-4822-b9ce-ba0517b1e143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1941e6d9-0cae-44d4-9874-c477d0cf6b53" returned: 0 in 0.805s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.956s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-459653587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c4d254-6c3b-4d78-ac10-299443e09ea4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ff05060998411080dccc8d81e3e970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:11Z,use_quota=True,user_id='cebfd957b2a04584976028787d00123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Creating volume 38c4d254-6c3b-4d78-ac10-299443e09ea4 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:13:13 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-38c4d254-6c3b-4d78-ac10-299443e09ea4 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eedd8f5d-d29d-4822-b9ce-ba0517b1e143) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e7056d27-e545-4e58-ace6-812c5f137846', 'volume_name': 'volume-e7056d27-e545-4e58-ace6-812c5f137846', 'volume_size': 1, 'source_volid': '13f96fa0-9248-438b-a18f-a177a92619b2', 'source_volstatus': 'available'}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0030128-a897-41b7-99d8-4a273f7f4f42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:13 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-38c4d254-6c3b-4d78-ac10-299443e09ea4 1073741824 Jul 08 01:13:13 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0030128-a897-41b7-99d8-4a273f7f4f42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f1c6234-2bee-414c-bfe6-6e9449a1ec9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:13 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Volume e7056d27-e545-4e58-ace6-812c5f137846: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e7056d27-e545-4e58-ace6-812c5f137846', 'volume_size': 1, 'source_volid': '13f96fa0-9248-438b-a18f-a177a92619b2', 'source_volstatus': 'available'} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de22eb3-583c-4a26-b85e-2dbd6032c910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1941e6d9-0cae-44d4-9874-c477d0cf6b53', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f1cc22-0559-456c-87fb-335c7fd6247c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:13 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Volume volume-1941e6d9-0cae-44d4-9874-c477d0cf6b53 (1941e6d9-0cae-44d4-9874-c477d0cf6b53): created successfully Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17f1cc22-0559-456c-87fb-335c7fd6247c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Flow 'volume_create_manager' (206e981c-dd74-488f-a3c8-ec85307497b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:13 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-ffc68249-8080-4ed5-a232-e3bfac7998d5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Created volume successfully. Jul 08 01:13:14 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-38c4d254-6c3b-4d78-ac10-299443e09ea4 1073741824" returned: 0 in 0.970s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-38c4d254-6c3b-4d78-ac10-299443e09ea4 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:14 devstack sudo[98849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-38c4d254-6c3b-4d78-ac10-299443e09ea4 Jul 08 01:13:14 devstack sudo[98849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:15 devstack sudo[98849]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-38c4d254-6c3b-4d78-ac10-299443e09ea4" returned: 0 in 0.723s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:13:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.505s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-800606969',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63e5cb7f-1986-456e-a9f4-062ab29ad0eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0bec86bef44a918bea26a9acae1350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:08Z,use_quota=True,user_id='cea1ed406bb64f1dbee53d406f9ec32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:13:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Creating volume 63e5cb7f-1986-456e-a9f4-062ab29ad0eb {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:13:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:13:15 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:13:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:15 devstack sudo[98852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb 1073741824 Jul 08 01:13:15 devstack sudo[98852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (657cb365-a951-4a52-8c7f-29b2ece8c333) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38c4d254-6c3b-4d78-ac10-299443e09ea4', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c21611a-3f0e-4b4e-9781-9ced2f6f9fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:15 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Volume volume-38c4d254-6c3b-4d78-ac10-299443e09ea4 (38c4d254-6c3b-4d78-ac10-299443e09ea4): created successfully Jul 08 01:13:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c21611a-3f0e-4b4e-9781-9ced2f6f9fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Flow 'volume_create_manager' (94b73a41-215d-40f2-a166-17c64373bfe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:15 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-98548775-054e-43c7-8f91-89578f6f84e7 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Created volume successfully. Jul 08 01:13:16 devstack sudo[98852]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb 1073741824" returned: 0 in 1.013s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:16 devstack sudo[98859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb Jul 08 01:13:16 devstack sudo[98859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:17 devstack sudo[98859]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb" returned: 0 in 0.691s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:13:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.766s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.090s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-989839266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57847b78-0915-41b6-a9a3-774fb8e50d63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ff05060998411080dccc8d81e3e970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:11Z,use_quota=True,user_id='cebfd957b2a04584976028787d00123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:13:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Creating volume 57847b78-0915-41b6-a9a3-774fb8e50d63 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:13:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:13:17 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:13:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-57847b78-0915-41b6-a9a3-774fb8e50d63 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:17 devstack sudo[98862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-57847b78-0915-41b6-a9a3-774fb8e50d63 1073741824 Jul 08 01:13:17 devstack sudo[98862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:17 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Attempting download of 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d ((None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}])) to volume 63e5cb7f-1986-456e-a9f4-062ab29ad0eb. {{(pid=87123) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:13:17 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[de42595e-ff15-40a4-ad98-13d6ef0d2cea]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_38477kkt {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:17 devstack sudo[98864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_38477kkt Jul 08 01:13:17 devstack sudo[98864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:18 devstack sudo[98864]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_38477kkt" returned: 0 in 0.815s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_38477kkt {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:18 devstack sudo[98862]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-57847b78-0915-41b6-a9a3-774fb8e50d63 1073741824" returned: 0 in 0.945s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-57847b78-0915-41b6-a9a3-774fb8e50d63 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:18 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-57847b78-0915-41b6-a9a3-774fb8e50d63 Jul 08 01:13:18 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:18 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_38477kkt Jul 08 01:13:18 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:19 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-57847b78-0915-41b6-a9a3-774fb8e50d63" returned: 0 in 0.714s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:13:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.719s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.433s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-854107232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d4252b0-5ec3-410f-b18c-447f6cfe75f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ff05060998411080dccc8d81e3e970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:11Z,use_quota=True,user_id='cebfd957b2a04584976028787d00123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:13:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Creating volume 6d4252b0-5ec3-410f-b18c-447f6cfe75f5 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:13:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:13:19 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:13:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d4252b0-5ec3-410f-b18c-447f6cfe75f5 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:19 devstack sudo[98878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d4252b0-5ec3-410f-b18c-447f6cfe75f5 1073741824 Jul 08 01:13:19 devstack sudo[98878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:19 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43185697-616c-4a34-805a-f44731a01f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57847b78-0915-41b6-a9a3-774fb8e50d63', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596fd0ec-44fc-4b20-8ed8-d6bb17e536e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_38477kkt" returned: 1 in 0.897s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_38477kkt' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:13:19 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa307b06-7953-4a41-8348-82c99d707521]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_dbkgbxvydevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:19 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Volume volume-57847b78-0915-41b6-a9a3-774fb8e50d63 (57847b78-0915-41b6-a9a3-774fb8e50d63): created successfully Jul 08 01:13:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596fd0ec-44fc-4b20-8ed8-d6bb17e536e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Flow 'volume_create_manager' (7c3eef8f-e3da-4a67-95b3-34d554fc53bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:19 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-ea60b9da-3870-4f3f-a699-0b2cdfd2d211 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Created volume successfully. Jul 08 01:13:19 devstack sudo[98880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_dbkgbxvydevstack@QuobyteHD Jul 08 01:13:19 devstack sudo[98880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:20 devstack sudo[98880]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_dbkgbxvydevstack@QuobyteHD" returned: 0 in 0.865s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:20 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d was qcow2, converting to raw {{(pid=87123) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:13:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_dbkgbxvydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:20 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_dbkgbxvydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb Jul 08 01:13:20 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:20 devstack sudo[98878]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d4252b0-5ec3-410f-b18c-447f6cfe75f5 1073741824" returned: 0 in 1.012s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d4252b0-5ec3-410f-b18c-447f6cfe75f5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:20 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d4252b0-5ec3-410f-b18c-447f6cfe75f5 Jul 08 01:13:20 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:20 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d4252b0-5ec3-410f-b18c-447f6cfe75f5" returned: 0 in 0.738s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:13:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.765s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-389299961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=614986e0-9527-4e67-9131-881899eeb0a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66ff05060998411080dccc8d81e3e970',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:12Z,use_quota=True,user_id='cebfd957b2a04584976028787d00123a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:13:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Creating volume 614986e0-9527-4e67-9131-881899eeb0a6 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:13:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:13:20 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:13:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-614986e0-9527-4e67-9131-881899eeb0a6 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:20 devstack sudo[98901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-614986e0-9527-4e67-9131-881899eeb0a6 1073741824 Jul 08 01:13:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04ea4f52-338f-4228-ae4d-163a32dbbf86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d4252b0-5ec3-410f-b18c-447f6cfe75f5', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:20 devstack sudo[98901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973ec7cb-1555-42fe-b38b-6cd677e3fc25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:20 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Volume volume-6d4252b0-5ec3-410f-b18c-447f6cfe75f5 (6d4252b0-5ec3-410f-b18c-447f6cfe75f5): created successfully Jul 08 01:13:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (973ec7cb-1555-42fe-b38b-6cd677e3fc25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Flow 'volume_create_manager' (3b62abc8-d7d9-4be7-96e0-71f8e92cbbfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:20 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-1d1cd36f-fca1-45d1-b7b6-75b72b048cc6 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Created volume successfully. Jul 08 01:13:21 devstack sudo[98901]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-614986e0-9527-4e67-9131-881899eeb0a6 1073741824" returned: 0 in 1.083s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-614986e0-9527-4e67-9131-881899eeb0a6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:21 devstack sudo[98913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-614986e0-9527-4e67-9131-881899eeb0a6 Jul 08 01:13:21 devstack sudo[98913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:22 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_dbkgbxvydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb" returned: 0 in 2.230s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:22 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_dbkgbxvydevstack@QuobyteHD, size 112.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:13:22 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Converted 112.00 MB image at 50.20 MB/s Jul 08 01:13:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:22 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb 1G Jul 08 01:13:22 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:22 devstack sudo[98913]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-614986e0-9527-4e67-9131-881899eeb0a6" returned: 0 in 0.730s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:22 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] <== create_volume: return (1865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:13:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.869s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 8.771s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:22 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Cloning volume 13f96fa0-9248-438b-a18f-a177a92619b2 to volume e7056d27-e545-4e58-ace6-812c5f137846 Jul 08 01:13:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454c2f63-5f53-44b8-8e38-aa4fde90af08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-614986e0-9527-4e67-9131-881899eeb0a6', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e781e56f-2464-4e71-a6dd-63892d4430f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:22 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Volume volume-614986e0-9527-4e67-9131-881899eeb0a6 (614986e0-9527-4e67-9131-881899eeb0a6): created successfully Jul 08 01:13:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e781e56f-2464-4e71-a6dd-63892d4430f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Flow 'volume_create_manager' (0b856547-dce3-4ec3-bae0-6185b621e21a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:22 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Creating offline snapshot 814a38ec-a868-4722-958c-0a715864dcb2 of volume 13f96fa0-9248-438b-a18f-a177a92619b2 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:13:22 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-654f3e96-c6a4-496f-92f0-9e5f99fa23c5 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Created volume successfully. Jul 08 01:13:22 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d10a6e3-a503-404d-979c-ea6ae3746831]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ad6591af-aab8-4d42-9e08-997f639a730c tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "cinder-614986e0-9527-4e67-9131-881899eeb0a6-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ad6591af-aab8-4d42-9e08-997f639a730c tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-614986e0-9527-4e67-9131-881899eeb0a6-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:22 devstack sudo[98918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2 Jul 08 01:13:22 devstack sudo[98918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ad6591af-aab8-4d42-9e08-997f639a730c tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "cinder-quobyte-614986e0-9527-4e67-9131-881899eeb0a6" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ad6591af-aab8-4d42-9e08-997f639a730c tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-quobyte-614986e0-9527-4e67-9131-881899eeb0a6" acquired by "delete_volume" :: waited 0.016s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:23 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b7fa51-4cd9-4952-bfe6-df3f323bfbdd]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ad6591af-aab8-4d42-9e08-997f639a730c tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-614986e0-9527-4e67-9131-881899eeb0a6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:23 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb 1G" returned: 0 in 0.886s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:23 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3aa33f-97a8-4c31-abf0-f6b929f52156]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:23 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-614986e0-9527-4e67-9131-881899eeb0a6 Jul 08 01:13:23 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:23 devstack sudo[98924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb Jul 08 01:13:23 devstack sudo[98924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:23 devstack sudo[98918]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2" returned: 0 in 0.931s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:23 devstack sudo[98930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2 1G Jul 08 01:13:23 devstack sudo[98930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:23 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ad6591af-aab8-4d42-9e08-997f639a730c tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-614986e0-9527-4e67-9131-881899eeb0a6" returned: 0 in 0.855s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ad6591af-aab8-4d42-9e08-997f639a730c tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-614986e0-9527-4e67-9131-881899eeb0a6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:23 devstack sudo[98937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-614986e0-9527-4e67-9131-881899eeb0a6 Jul 08 01:13:23 devstack sudo[98937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:24 devstack sudo[98924]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb" returned: 0 in 0.920s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:24 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb Jul 08 01:13:24 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:24 devstack sudo[98930]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2 1G" returned: 0 in 0.904s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13f96fa0-9248-438b-a18f-a177a92619b2 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:24 devstack sudo[98945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13f96fa0-9248-438b-a18f-a177a92619b2 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2 Jul 08 01:13:24 devstack sudo[98937]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:24 devstack sudo[98945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ad6591af-aab8-4d42-9e08-997f639a730c tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-614986e0-9527-4e67-9131-881899eeb0a6" returned: 0 in 0.728s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ad6591af-aab8-4d42-9e08-997f639a730c tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-quobyte-614986e0-9527-4e67-9131-881899eeb0a6" released by "delete_volume" :: held 1.647s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:24 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-ad6591af-aab8-4d42-9e08-997f639a730c tempest-CreateVolumesFromSnapshotTest-1516322981 None] Created reservations ['a87a862a-52ac-48e9-b9ec-cf7891e61fe9', '3559ea90-0c68-4e20-ad37-f379a337e634', '00cff288-fde0-4354-a735-d5baa9e9b7f6', '48657927-beed-40ca-a697-af6864a234a5'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ad6591af-aab8-4d42-9e08-997f639a730c tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ad6591af-aab8-4d42-9e08-997f639a730c tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ad6591af-aab8-4d42-9e08-997f639a730c tempest-CreateVolumesFromSnapshotTest-1516322981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ad6591af-aab8-4d42-9e08-997f639a730c tempest-CreateVolumesFromSnapshotTest-1516322981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ad6591af-aab8-4d42-9e08-997f639a730c tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ad6591af-aab8-4d42-9e08-997f639a730c tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:24 devstack sudo[98947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:13:24 devstack sudo[98947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:25 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb" returned: 1 in 0.912s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:13:25 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Downloaded image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d ((None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}])) to volume 63e5cb7f-1986-456e-a9f4-062ab29ad0eb successfully. {{(pid=87123) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:13:25 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Temporary image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d for user cea1ed406bb64f1dbee53d406f9ec32e is deleted. {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:13:25 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Marking volume 63e5cb7f-1986-456e-a9f4-062ab29ad0eb as bootable. {{(pid=87123) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:13:25 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Copying metadata from image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d to 63e5cb7f-1986-456e-a9f4-062ab29ad0eb. {{(pid=87123) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:13:25 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Creating volume glance metadata for volume 63e5cb7f-1986-456e-a9f4-062ab29ad0eb backed by image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87123) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:13:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d02ac86-4e85-4868-8ab5-8b1ed812e497) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb', 'volume_size': 1, 'image_id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '464063acafa44f9e90fd1bca62b64e8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'created_at': datetime.datetime(2026, 7, 7, 22, 51, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 51, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06da07d5-4846-40f1-90c5-6163bfe5475c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:25 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Volume volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb (63e5cb7f-1986-456e-a9f4-062ab29ad0eb): created successfully Jul 08 01:13:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06da07d5-4846-40f1-90c5-6163bfe5475c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Flow 'volume_create_manager' (771a0b4e-94f9-47d9-b1d1-d4387c4a4f19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:25 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-aa237383-009d-4bb6-b286-0fe537d6f6e4 tempest-VolumesExtendTest-1417397802 None] Created volume successfully. Jul 08 01:13:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-22204409-0b99-48de-8777-450c717b3146 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "cinder-6d4252b0-5ec3-410f-b18c-447f6cfe75f5-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-22204409-0b99-48de-8777-450c717b3146 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-6d4252b0-5ec3-410f-b18c-447f6cfe75f5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-22204409-0b99-48de-8777-450c717b3146 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "cinder-quobyte-6d4252b0-5ec3-410f-b18c-447f6cfe75f5" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-22204409-0b99-48de-8777-450c717b3146 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-quobyte-6d4252b0-5ec3-410f-b18c-447f6cfe75f5" acquired by "delete_volume" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:25 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a06898-45d3-492a-b3b2-31ec5580f737]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-22204409-0b99-48de-8777-450c717b3146 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d4252b0-5ec3-410f-b18c-447f6cfe75f5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:25 devstack sudo[98954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d4252b0-5ec3-410f-b18c-447f6cfe75f5 Jul 08 01:13:25 devstack sudo[98954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:25 devstack sudo[98945]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13f96fa0-9248-438b-a18f-a177a92619b2 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2" returned: 0 in 0.988s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:25 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2 is being set with open permissions: ugo+rw Jul 08 01:13:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:25 devstack sudo[98947]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ad6591af-aab8-4d42-9e08-997f639a730c tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.812s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:25 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-ad6591af-aab8-4d42-9e08-997f639a730c tempest-CreateVolumesFromSnapshotTest-1516322981 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:25 devstack sudo[98958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2 Jul 08 01:13:25 devstack sudo[98958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:25 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-ad6591af-aab8-4d42-9e08-997f639a730c tempest-CreateVolumesFromSnapshotTest-1516322981 None] Deleted volume successfully. Jul 08 01:13:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ad6591af-aab8-4d42-9e08-997f639a730c tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-614986e0-9527-4e67-9131-881899eeb0a6-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:26 devstack sudo[98954]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-22204409-0b99-48de-8777-450c717b3146 tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d4252b0-5ec3-410f-b18c-447f6cfe75f5" returned: 0 in 0.893s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-22204409-0b99-48de-8777-450c717b3146 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d4252b0-5ec3-410f-b18c-447f6cfe75f5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:26 devstack sudo[98964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d4252b0-5ec3-410f-b18c-447f6cfe75f5 Jul 08 01:13:26 devstack sudo[98964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:26 devstack sudo[98958]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2" returned: 0 in 0.775s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:26 devstack sudo[98966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.info Jul 08 01:13:26 devstack sudo[98966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-10497ef3-e471-4dfc-ab6c-64c39428677f tempest-VolumesExtendTest-1417397802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:27 devstack sudo[98964]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-22204409-0b99-48de-8777-450c717b3146 tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6d4252b0-5ec3-410f-b18c-447f6cfe75f5" returned: 0 in 0.741s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:27 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-22204409-0b99-48de-8777-450c717b3146 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-quobyte-6d4252b0-5ec3-410f-b18c-447f6cfe75f5" released by "delete_volume" :: held 1.706s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:27 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-22204409-0b99-48de-8777-450c717b3146 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Created reservations ['a6541080-9307-40bc-a74b-042ff7715307', '57eae64f-7cc4-409c-a577-8e80efb23e89', '14b3f209-3916-43b3-b9f1-b066c0a7ef94', 'a5cd95d5-c8db-49c7-93e5-4b291a3abfbf'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:27 devstack sudo[98966]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.info" returned: 0 in 0.804s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:27 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.info is being set with open permissions: ugo+rw Jul 08 01:13:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:27 devstack sudo[98970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.info Jul 08 01:13:27 devstack sudo[98970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-22204409-0b99-48de-8777-450c717b3146 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-22204409-0b99-48de-8777-450c717b3146 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-22204409-0b99-48de-8777-450c717b3146 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-22204409-0b99-48de-8777-450c717b3146 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-22204409-0b99-48de-8777-450c717b3146 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-22204409-0b99-48de-8777-450c717b3146 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:27 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:13:27 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:27 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ea782660-3349-4292-a48a-ef11dcec98fa tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "cinder-57847b78-0915-41b6-a9a3-774fb8e50d63-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:27 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ea782660-3349-4292-a48a-ef11dcec98fa tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-57847b78-0915-41b6-a9a3-774fb8e50d63-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:27 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ea782660-3349-4292-a48a-ef11dcec98fa tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "cinder-quobyte-57847b78-0915-41b6-a9a3-774fb8e50d63" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:27 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ea782660-3349-4292-a48a-ef11dcec98fa tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-quobyte-57847b78-0915-41b6-a9a3-774fb8e50d63" acquired by "delete_volume" :: waited 0.017s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:27 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ed60c56-c1c3-4aa4-8038-bd7a085ce5e9]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ea782660-3349-4292-a48a-ef11dcec98fa tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-57847b78-0915-41b6-a9a3-774fb8e50d63 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:27 devstack sudo[98974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-57847b78-0915-41b6-a9a3-774fb8e50d63 Jul 08 01:13:27 devstack sudo[98974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:27 devstack sudo[98970]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.info" returned: 0 in 0.696s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:27 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Acquiring lock "cinder-quobyte-e7056d27-e545-4e58-ace6-812c5f137846" by "_copy_volume_from_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Lock "cinder-quobyte-e7056d27-e545-4e58-ace6-812c5f137846" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:28 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] snapshot: 814a38ec-a868-4722-958c-0a715864dcb2, volume: e7056d27-e545-4e58-ace6-812c5f137846, {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:13:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:28 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:28 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:28 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[3940b8b6-0302-4e11-b317-7f7af100d7c2]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:28 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-22204409-0b99-48de-8777-450c717b3146 tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.834s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:28 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-22204409-0b99-48de-8777-450c717b3146 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:28 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-22204409-0b99-48de-8777-450c717b3146 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Deleted volume successfully. Jul 08 01:13:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-22204409-0b99-48de-8777-450c717b3146 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-6d4252b0-5ec3-410f-b18c-447f6cfe75f5-delete_volume" released by "delete_volume" :: held 2.826s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:28 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2 Jul 08 01:13:28 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:28 devstack sudo[98974]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ea782660-3349-4292-a48a-ef11dcec98fa tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-57847b78-0915-41b6-a9a3-774fb8e50d63" returned: 0 in 0.830s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ea782660-3349-4292-a48a-ef11dcec98fa tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-57847b78-0915-41b6-a9a3-774fb8e50d63 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:28 devstack sudo[98983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-57847b78-0915-41b6-a9a3-774fb8e50d63 Jul 08 01:13:28 devstack sudo[98983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:28 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2" returned: 0 in 0.923s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:28 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13f96fa0-9248-438b-a18f-a177a92619b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:13:28 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2 {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:13:28 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Creating direct copy from snapshot {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:13:28 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5679197-f1be-4e3c-a3a4-c025d2897244]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:29 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2 Jul 08 01:13:29 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:29 devstack sudo[98983]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ea782660-3349-4292-a48a-ef11dcec98fa tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-57847b78-0915-41b6-a9a3-774fb8e50d63" returned: 0 in 0.739s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:29 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ea782660-3349-4292-a48a-ef11dcec98fa tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-quobyte-57847b78-0915-41b6-a9a3-774fb8e50d63" released by "delete_volume" :: held 1.617s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:29 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-ea782660-3349-4292-a48a-ef11dcec98fa tempest-CreateVolumesFromSnapshotTest-1516322981 None] Created reservations ['3e3d674e-0b44-45fe-bdeb-669bb9cc41f1', '910c21f8-a0dc-444f-8a32-bd80c29ba339', 'c9d3bf00-a024-4f09-88df-270335305d7f', 'fed94ccd-6f5c-4f36-807a-c33bee6cc074'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ea782660-3349-4292-a48a-ef11dcec98fa tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ea782660-3349-4292-a48a-ef11dcec98fa tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:29 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ea782660-3349-4292-a48a-ef11dcec98fa tempest-CreateVolumesFromSnapshotTest-1516322981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:29 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ea782660-3349-4292-a48a-ef11dcec98fa tempest-CreateVolumesFromSnapshotTest-1516322981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ea782660-3349-4292-a48a-ef11dcec98fa tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ea782660-3349-4292-a48a-ef11dcec98fa tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:29 devstack sudo[98991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:13:29 devstack sudo[98991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:29 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2" returned: 0 in 0.872s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:29 devstack cinder-volume[87123]: DEBUG cinder.utils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Path /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e7056d27-e545-4e58-ace6-812c5f137846 not found in is_blk_device check {{(pid=87123) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:13:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e7056d27-e545-4e58-ace6-812c5f137846 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:29 devstack sudo[98996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e7056d27-e545-4e58-ace6-812c5f137846 Jul 08 01:13:29 devstack sudo[98996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:29 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-de01223f-64f6-4818-b4b4-ffa444483566 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "cinder-38c4d254-6c3b-4d78-ac10-299443e09ea4-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:29 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-de01223f-64f6-4818-b4b4-ffa444483566 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-38c4d254-6c3b-4d78-ac10-299443e09ea4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:30 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-de01223f-64f6-4818-b4b4-ffa444483566 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "cinder-quobyte-38c4d254-6c3b-4d78-ac10-299443e09ea4" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:30 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-de01223f-64f6-4818-b4b4-ffa444483566 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-quobyte-38c4d254-6c3b-4d78-ac10-299443e09ea4" acquired by "delete_volume" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:30 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae9d100-0b1b-4ed1-98b5-bf4bc3aee429]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-de01223f-64f6-4818-b4b4-ffa444483566 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-38c4d254-6c3b-4d78-ac10-299443e09ea4 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:30 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-38c4d254-6c3b-4d78-ac10-299443e09ea4 Jul 08 01:13:30 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:30 devstack sudo[98991]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ea782660-3349-4292-a48a-ef11dcec98fa tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.753s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:30 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-ea782660-3349-4292-a48a-ef11dcec98fa tempest-CreateVolumesFromSnapshotTest-1516322981 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:30 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-ea782660-3349-4292-a48a-ef11dcec98fa tempest-CreateVolumesFromSnapshotTest-1516322981 None] Deleted volume successfully. Jul 08 01:13:30 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ea782660-3349-4292-a48a-ef11dcec98fa tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-57847b78-0915-41b6-a9a3-774fb8e50d63-delete_volume" released by "delete_volume" :: held 2.645s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:31 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-de01223f-64f6-4818-b4b4-ffa444483566 tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-38c4d254-6c3b-4d78-ac10-299443e09ea4" returned: 0 in 0.923s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-de01223f-64f6-4818-b4b4-ffa444483566 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-38c4d254-6c3b-4d78-ac10-299443e09ea4 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:31 devstack sudo[99015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-38c4d254-6c3b-4d78-ac10-299443e09ea4 Jul 08 01:13:31 devstack sudo[99015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:32 devstack sudo[99015]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-de01223f-64f6-4818-b4b4-ffa444483566 tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-38c4d254-6c3b-4d78-ac10-299443e09ea4" returned: 0 in 1.577s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:32 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-de01223f-64f6-4818-b4b4-ffa444483566 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-quobyte-38c4d254-6c3b-4d78-ac10-299443e09ea4" released by "delete_volume" :: held 2.574s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:32 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-de01223f-64f6-4818-b4b4-ffa444483566 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Created reservations ['fa9c3d04-12d6-4042-b782-49dfcb849e99', '1a2c0758-7dc7-4ce4-8b1e-905f23d17946', 'f3b512fd-9976-40dc-9d9d-f07298d4bb54', '7ce6c489-eeff-41c7-a9eb-edebb4381a24'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-de01223f-64f6-4818-b4b4-ffa444483566 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-de01223f-64f6-4818-b4b4-ffa444483566 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-de01223f-64f6-4818-b4b4-ffa444483566 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-de01223f-64f6-4818-b4b4-ffa444483566 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-de01223f-64f6-4818-b4b4-ffa444483566 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-de01223f-64f6-4818-b4b4-ffa444483566 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:33 devstack sudo[99018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:13:33 devstack sudo[99018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d7d1e684-0a08-48f1-b4e2-763a349bffc1 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "cinder-1941e6d9-0cae-44d4-9874-c477d0cf6b53-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d7d1e684-0a08-48f1-b4e2-763a349bffc1 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-1941e6d9-0cae-44d4-9874-c477d0cf6b53-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d7d1e684-0a08-48f1-b4e2-763a349bffc1 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "cinder-quobyte-1941e6d9-0cae-44d4-9874-c477d0cf6b53" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d7d1e684-0a08-48f1-b4e2-763a349bffc1 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-quobyte-1941e6d9-0cae-44d4-9874-c477d0cf6b53" acquired by "delete_volume" :: waited 0.054s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:34 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[672d572d-278d-42b7-a09c-7a0d4f23ad4d]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d7d1e684-0a08-48f1-b4e2-763a349bffc1 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1941e6d9-0cae-44d4-9874-c477d0cf6b53 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:34 devstack sudo[99022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1941e6d9-0cae-44d4-9874-c477d0cf6b53 Jul 08 01:13:34 devstack sudo[99022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:34 devstack sudo[99018]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-de01223f-64f6-4818-b4b4-ffa444483566 tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.697s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:34 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-de01223f-64f6-4818-b4b4-ffa444483566 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:34 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-de01223f-64f6-4818-b4b4-ffa444483566 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Deleted volume successfully. Jul 08 01:13:34 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-de01223f-64f6-4818-b4b4-ffa444483566 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-38c4d254-6c3b-4d78-ac10-299443e09ea4-delete_volume" released by "delete_volume" :: held 4.763s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:35 devstack sudo[98996]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e7056d27-e545-4e58-ace6-812c5f137846" returned: 0 in 5.801s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:35 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[65b09465-b9cd-414f-ab0f-768a06f0d8f4]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:35 devstack sudo[99022]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d7d1e684-0a08-48f1-b4e2-763a349bffc1 tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1941e6d9-0cae-44d4-9874-c477d0cf6b53" returned: 0 in 1.778s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d7d1e684-0a08-48f1-b4e2-763a349bffc1 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1941e6d9-0cae-44d4-9874-c477d0cf6b53 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:35 devstack sudo[99028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2 Jul 08 01:13:35 devstack sudo[99028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:35 devstack sudo[99029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1941e6d9-0cae-44d4-9874-c477d0cf6b53 Jul 08 01:13:35 devstack sudo[99029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:36 devstack sudo[99029]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d7d1e684-0a08-48f1-b4e2-763a349bffc1 tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1941e6d9-0cae-44d4-9874-c477d0cf6b53" returned: 0 in 0.699s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:36 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d7d1e684-0a08-48f1-b4e2-763a349bffc1 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-quobyte-1941e6d9-0cae-44d4-9874-c477d0cf6b53" released by "delete_volume" :: held 2.562s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:36 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-d7d1e684-0a08-48f1-b4e2-763a349bffc1 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Created reservations ['e385ee83-43fe-44e1-a0b7-af2e28da0364', '52cb173e-9145-484f-a711-4944e69b01dd', 'bb03c79a-d343-4376-8534-769a4422b9b9', 'c2fa532a-71c2-46b4-b051-1758e8d3b478'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d7d1e684-0a08-48f1-b4e2-763a349bffc1 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d7d1e684-0a08-48f1-b4e2-763a349bffc1 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d7d1e684-0a08-48f1-b4e2-763a349bffc1 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d7d1e684-0a08-48f1-b4e2-763a349bffc1 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d7d1e684-0a08-48f1-b4e2-763a349bffc1 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d7d1e684-0a08-48f1-b4e2-763a349bffc1 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:36 devstack sudo[99028]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2" returned: 0 in 1.030s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:36 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Image conversion details: src /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2, size 1024.00 MB, duration 5.80 sec, destination /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e7056d27-e545-4e58-ace6-812c5f137846 {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:13:36 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Converted 1024.00 MB image at 176.49 MB/s Jul 08 01:13:36 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e7056d27-e545-4e58-ace6-812c5f137846 is being set with open permissions: ugo+rw Jul 08 01:13:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e7056d27-e545-4e58-ace6-812c5f137846 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:36 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:13:36 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:36 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e7056d27-e545-4e58-ace6-812c5f137846 Jul 08 01:13:36 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:37 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-83bed04b-dcae-4dc3-a39f-9186c924719b tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "cinder-fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:37 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-83bed04b-dcae-4dc3-a39f-9186c924719b tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:37 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-83bed04b-dcae-4dc3-a39f-9186c924719b tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "cinder-quobyte-04470f96-0e59-40fc-9370-553d6b40463a" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:37 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-83bed04b-dcae-4dc3-a39f-9186c924719b tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-quobyte-04470f96-0e59-40fc-9370-553d6b40463a" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:37 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-83bed04b-dcae-4dc3-a39f-9186c924719b tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "cinder-quobyte-fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:37 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-83bed04b-dcae-4dc3-a39f-9186c924719b tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-quobyte-fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-83bed04b-dcae-4dc3-a39f-9186c924719b tempest-CreateVolumesFromSnapshotTest-1516322981 None] Deleting offline snapshot fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f of volume 04470f96-0e59-40fc-9370-553d6b40463a {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:13:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-83bed04b-dcae-4dc3-a39f-9186c924719b tempest-CreateVolumesFromSnapshotTest-1516322981 None] snapshot_file for this snap is: volume-04470f96-0e59-40fc-9370-553d6b40463a.fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:13:37 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[4765ba59-2d42-4eee-963b-69e6a19b634b]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-83bed04b-dcae-4dc3-a39f-9186c924719b tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:37 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d7d1e684-0a08-48f1-b4e2-763a349bffc1 tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.750s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:37 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-d7d1e684-0a08-48f1-b4e2-763a349bffc1 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:37 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-d7d1e684-0a08-48f1-b4e2-763a349bffc1 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Deleted volume successfully. Jul 08 01:13:37 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e7056d27-e545-4e58-ace6-812c5f137846" returned: 0 in 0.745s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:37 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d7d1e684-0a08-48f1-b4e2-763a349bffc1 tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-1941e6d9-0cae-44d4-9874-c477d0cf6b53-delete_volume" released by "delete_volume" :: held 3.685s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:37 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Lock "cinder-quobyte-e7056d27-e545-4e58-ace6-812c5f137846" released by "_copy_volume_from_snapshot" :: held 9.470s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:37 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Acquiring lock "cinder-quobyte-814a38ec-a868-4722-958c-0a715864dcb2" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:37 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Lock "cinder-quobyte-814a38ec-a868-4722-958c-0a715864dcb2" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Deleting offline snapshot 814a38ec-a868-4722-958c-0a715864dcb2 of volume 13f96fa0-9248-438b-a18f-a177a92619b2 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:13:37 devstack sudo[99042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f Jul 08 01:13:37 devstack sudo[99042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] snapshot_file for this snap is: volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:13:37 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[97519249-9b1a-469a-b3ed-9ea29dbba107]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:37 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2 Jul 08 01:13:37 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:38 devstack sudo[99042]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-83bed04b-dcae-4dc3-a39f-9186c924719b tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f" returned: 0 in 0.999s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-83bed04b-dcae-4dc3-a39f-9186c924719b tempest-CreateVolumesFromSnapshotTest-1516322981 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-04470f96-0e59-40fc-9370-553d6b40463a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:13:38 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0f0830-54df-45e2-9af4-5ffa2d6cc3e6]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-83bed04b-dcae-4dc3-a39f-9186c924719b tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:38 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2" returned: 0 in 0.982s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13f96fa0-9248-438b-a18f-a177a92619b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:13:38 devstack sudo[99053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a Jul 08 01:13:38 devstack sudo[99053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:38 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e89204f-1bdb-4ed1-97e3-d1a2318e80a8]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:38 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2 Jul 08 01:13:38 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:39 devstack sudo[99053]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-83bed04b-dcae-4dc3-a39f-9186c924719b tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a" returned: 0 in 0.954s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-83bed04b-dcae-4dc3-a39f-9186c924719b tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:39 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f Jul 08 01:13:39 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:39 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2" returned: 0 in 0.905s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:39 devstack sudo[99065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2 Jul 08 01:13:39 devstack sudo[99065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:40 devstack sudo[99065]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2" returned: 0 in 0.838s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:40 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-83bed04b-dcae-4dc3-a39f-9186c924719b tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f" returned: 0 in 0.934s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-83bed04b-dcae-4dc3-a39f-9186c924719b tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:40 devstack sudo[99076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2 Jul 08 01:13:40 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:40 devstack sudo[99077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f Jul 08 01:13:40 devstack sudo[99077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:41 devstack sudo[99077]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:41 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-83bed04b-dcae-4dc3-a39f-9186c924719b tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a.fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f" returned: 0 in 0.740s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2.814a38ec-a868-4722-958c-0a715864dcb2" returned: 0 in 0.760s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:41 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Lock "cinder-quobyte-814a38ec-a868-4722-958c-0a715864dcb2" released by "_delete_snapshot" :: held 3.586s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:41 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-83bed04b-dcae-4dc3-a39f-9186c924719b tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-quobyte-fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f" released by "_delete_snapshot" :: held 3.777s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:41 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-83bed04b-dcae-4dc3-a39f-9186c924719b tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-quobyte-04470f96-0e59-40fc-9370-553d6b40463a" released by "delete_snapshot" :: held 3.808s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.480s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-10497ef3-e471-4dfc-ab6c-64c39428677f tempest-VolumesExtendTest-1417397802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 14.644s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f1c6234-2bee-414c-bfe6-6e9449a1ec9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7056d27-e545-4e58-ace6-812c5f137846', 'volume_size': 1, 'source_volid': '13f96fa0-9248-438b-a18f-a177a92619b2', 'source_volstatus': 'available'}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (748c3f98-c86c-4357-b93c-ca4309e283b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:41 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[364fc47b-161e-42a3-9696-3093d4859d57]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-10497ef3-e471-4dfc-ab6c-64c39428677f tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:41 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Volume volume-e7056d27-e545-4e58-ace6-812c5f137846 (e7056d27-e545-4e58-ace6-812c5f137846): created successfully Jul 08 01:13:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (748c3f98-c86c-4357-b93c-ca4309e283b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Flow 'volume_create_manager' (a889d9f3-fd21-4ef7-9067-b15e6b7c73b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:41 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-25a67e6b-5fde-45f8-8945-1aa0c8dd7fd2 tempest-VolumesGetTest-1383156073 None] Created volume successfully. Jul 08 01:13:41 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-83bed04b-dcae-4dc3-a39f-9186c924719b tempest-CreateVolumesFromSnapshotTest-1516322981 None] Created reservations ['b382e5e1-786b-4c5e-a445-c1fa853b5132', '2b323cce-9f09-425c-8a36-398ef90b4b8a', '0610a247-7923-481e-a927-7776428c5057', 'cdaa778e-85af-48f0-b7f7-f857d142eab8'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:41 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb Jul 08 01:13:41 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-83bed04b-dcae-4dc3-a39f-9186c924719b tempest-CreateVolumesFromSnapshotTest-1516322981 None] Delete snapshot completed successfully. Jul 08 01:13:41 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:41 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-83bed04b-dcae-4dc3-a39f-9186c924719b tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-fe6fc4af-614f-4ce6-a1e6-a17ffe92eb4f-delete_snapshot" released by "delete_snapshot" :: held 4.071s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:41 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-772706be-6116-47b6-a5e7-7245faa0f96d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "cinder-04470f96-0e59-40fc-9370-553d6b40463a-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:41 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-772706be-6116-47b6-a5e7-7245faa0f96d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-04470f96-0e59-40fc-9370-553d6b40463a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:41 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-772706be-6116-47b6-a5e7-7245faa0f96d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "cinder-quobyte-04470f96-0e59-40fc-9370-553d6b40463a" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:41 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-772706be-6116-47b6-a5e7-7245faa0f96d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-quobyte-04470f96-0e59-40fc-9370-553d6b40463a" acquired by "delete_volume" :: waited 0.017s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:41 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[423c860b-f318-4c40-98bf-0f24689041ef]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-772706be-6116-47b6-a5e7-7245faa0f96d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:41 devstack sudo[99085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a Jul 08 01:13:41 devstack sudo[99085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:42 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-10497ef3-e471-4dfc-ab6c-64c39428677f tempest-VolumesExtendTest-1417397802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb" returned: 0 in 0.878s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-10497ef3-e471-4dfc-ab6c-64c39428677f tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:42 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb Jul 08 01:13:42 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:42 devstack sudo[99085]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-772706be-6116-47b6-a5e7-7245faa0f96d tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a" returned: 0 in 0.890s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-772706be-6116-47b6-a5e7-7245faa0f96d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:42 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a Jul 08 01:13:42 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:42 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:13:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Flow 'volume_create_manager' (089ce678-8192-43ba-88e9-c98fdcb84e5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d3458a7-8086-486c-bb3f-8def95a1c984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d3458a7-8086-486c-bb3f-8def95a1c984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2039164302',display_name='tempest-VolumesGetTest-Volume-1833994651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20956056-56a6-4542-8d5b-75f20b986f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6f26dc7b994b93b6971961999c2024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:43Z,use_quota=True,user_id='d00eed277f2645bcb23874586fa7058a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c3778b-190d-49c5-929e-fd3fdf0570b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12c3778b-190d-49c5-929e-fd3fdf0570b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6bf42ac-5641-4155-b594-c5499c670e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6bf42ac-5641-4155-b594-c5499c670e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20956056-56a6-4542-8d5b-75f20b986f85', 'volume_name': 'volume-20956056-56a6-4542-8d5b-75f20b986f85', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d3c164-d796-48a8-b509-3245719edabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35d3c164-d796-48a8-b509-3245719edabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9689ea6-4e1b-458d-8ee8-726aba168905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:43 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Volume 20956056-56a6-4542-8d5b-75f20b986f85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20956056-56a6-4542-8d5b-75f20b986f85', 'volume_size': 1} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:43 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-10497ef3-e471-4dfc-ab6c-64c39428677f tempest-VolumesExtendTest-1417397802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb" returned: 1 in 0.929s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-10497ef3-e471-4dfc-ab6c-64c39428677f tempest-VolumesExtendTest-1417397802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-10497ef3-e471-4dfc-ab6c-64c39428677f tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb 2G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-10497ef3-e471-4dfc-ab6c-64c39428677f tempest-VolumesExtendTest-1417397802 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb 2G" returned: 0 in 0.085s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-10497ef3-e471-4dfc-ab6c-64c39428677f tempest-VolumesExtendTest-1417397802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.939s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.125s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:42Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2039164302',display_name='tempest-VolumesGetTest-Volume-1833994651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20956056-56a6-4542-8d5b-75f20b986f85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6f26dc7b994b93b6971961999c2024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:43Z,use_quota=True,user_id='d00eed277f2645bcb23874586fa7058a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Creating volume 20956056-56a6-4542-8d5b-75f20b986f85 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:13:43 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20956056-56a6-4542-8d5b-75f20b986f85 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:43 devstack sudo[99104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20956056-56a6-4542-8d5b-75f20b986f85 1073741824 Jul 08 01:13:43 devstack sudo[99104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:43 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-10497ef3-e471-4dfc-ab6c-64c39428677f tempest-VolumesExtendTest-1417397802 None] Extend volume completed successfully. Jul 08 01:13:43 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-772706be-6116-47b6-a5e7-7245faa0f96d tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04470f96-0e59-40fc-9370-553d6b40463a" returned: 0 in 0.756s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-772706be-6116-47b6-a5e7-7245faa0f96d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-quobyte-04470f96-0e59-40fc-9370-553d6b40463a" released by "delete_volume" :: held 1.722s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-772706be-6116-47b6-a5e7-7245faa0f96d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Created reservations ['6ee637d4-8031-471f-a2b8-e0257414f0e2', 'd06e4b2d-d232-4d45-8ef3-5173bebe812c', '08bd8c7d-149e-4e2e-bf19-700b7dee13ff', 'ac2c14d1-8887-4745-a35e-fca8574edcdf'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-772706be-6116-47b6-a5e7-7245faa0f96d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-772706be-6116-47b6-a5e7-7245faa0f96d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-772706be-6116-47b6-a5e7-7245faa0f96d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-772706be-6116-47b6-a5e7-7245faa0f96d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-772706be-6116-47b6-a5e7-7245faa0f96d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-772706be-6116-47b6-a5e7-7245faa0f96d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:43 devstack sudo[99107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:13:43 devstack sudo[99107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:44 devstack sudo[99104]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20956056-56a6-4542-8d5b-75f20b986f85 1073741824" returned: 0 in 0.999s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20956056-56a6-4542-8d5b-75f20b986f85 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:44 devstack sudo[99114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20956056-56a6-4542-8d5b-75f20b986f85 Jul 08 01:13:44 devstack sudo[99114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:44 devstack sudo[99107]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-772706be-6116-47b6-a5e7-7245faa0f96d tempest-CreateVolumesFromSnapshotTest-1516322981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.774s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:44 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-772706be-6116-47b6-a5e7-7245faa0f96d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:44 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-772706be-6116-47b6-a5e7-7245faa0f96d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Deleted volume successfully. Jul 08 01:13:44 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-772706be-6116-47b6-a5e7-7245faa0f96d tempest-CreateVolumesFromSnapshotTest-1516322981 None] Lock "cinder-04470f96-0e59-40fc-9370-553d6b40463a-delete_volume" released by "delete_volume" :: held 2.724s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:44 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] Acquiring lock "cinder-63e5cb7f-1986-456e-a9f4-062ab29ad0eb-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:44 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] Lock "cinder-63e5cb7f-1986-456e-a9f4-062ab29ad0eb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:44 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] Acquiring lock "cinder-quobyte-63e5cb7f-1986-456e-a9f4-062ab29ad0eb" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:44 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] Lock "cinder-quobyte-63e5cb7f-1986-456e-a9f4-062ab29ad0eb" acquired by "delete_volume" :: waited 0.027s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:44 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8fa51b-afe3-4601-89d1-d5125a169f0a]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:44 devstack sudo[99116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb Jul 08 01:13:44 devstack sudo[99116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:13:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:45 devstack sudo[99119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:13:45 devstack sudo[99119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:45 devstack sudo[99114]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20956056-56a6-4542-8d5b-75f20b986f85" returned: 0 in 0.918s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:45 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] <== create_volume: return (1978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:13:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.982s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9689ea6-4e1b-458d-8ee8-726aba168905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20956056-56a6-4542-8d5b-75f20b986f85', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35931510-87e2-4c56-9501-0d24bef2b8d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:45 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Volume volume-20956056-56a6-4542-8d5b-75f20b986f85 (20956056-56a6-4542-8d5b-75f20b986f85): created successfully Jul 08 01:13:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35931510-87e2-4c56-9501-0d24bef2b8d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Flow 'volume_create_manager' (089ce678-8192-43ba-88e9-c98fdcb84e5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:45 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-4904f0af-4e97-466b-9a78-2d9f04713c31 tempest-VolumesGetTest-1383156073 None] Created volume successfully. Jul 08 01:13:45 devstack sudo[99116]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb" returned: 0 in 0.928s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:45 devstack sudo[99119]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.797s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:45 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:45 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:13:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 28 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:13:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:13:45 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb Jul 08 01:13:45 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0f355929-dff7-4847-8ab6-01a3b670e4d6 tempest-VolumesGetTest-1383156073 None] Acquiring lock "cinder-20956056-56a6-4542-8d5b-75f20b986f85-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0f355929-dff7-4847-8ab6-01a3b670e4d6 tempest-VolumesGetTest-1383156073 None] Lock "cinder-20956056-56a6-4542-8d5b-75f20b986f85-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0f355929-dff7-4847-8ab6-01a3b670e4d6 tempest-VolumesGetTest-1383156073 None] Acquiring lock "cinder-quobyte-20956056-56a6-4542-8d5b-75f20b986f85" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0f355929-dff7-4847-8ab6-01a3b670e4d6 tempest-VolumesGetTest-1383156073 None] Lock "cinder-quobyte-20956056-56a6-4542-8d5b-75f20b986f85" acquired by "delete_volume" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:46 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb" returned: 1 in 0.858s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:13:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:46 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[7369a2ed-c0ca-45c2-bb79-832c8ed20a98]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0f355929-dff7-4847-8ab6-01a3b670e4d6 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20956056-56a6-4542-8d5b-75f20b986f85 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:46 devstack sudo[99129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb Jul 08 01:13:46 devstack sudo[99129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:46 devstack sudo[99130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20956056-56a6-4542-8d5b-75f20b986f85 Jul 08 01:13:46 devstack sudo[99130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:47 devstack sudo[99129]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-63e5cb7f-1986-456e-a9f4-062ab29ad0eb" returned: 0 in 0.716s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] Lock "cinder-quobyte-63e5cb7f-1986-456e-a9f4-062ab29ad0eb" released by "delete_volume" :: held 2.583s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:47 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] Created reservations ['4b603e30-5bae-45ee-b70f-d3eb7625735f', '1e9a67de-8c43-4693-9623-0519ed9172eb', '85ae0494-ab82-4224-8aa6-f27f9fc3ee2e', '42099e18-96bb-4b16-93a0-3baf1f710324'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:47 devstack sudo[99130]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0f355929-dff7-4847-8ab6-01a3b670e4d6 tempest-VolumesGetTest-1383156073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20956056-56a6-4542-8d5b-75f20b986f85" returned: 0 in 0.832s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0f355929-dff7-4847-8ab6-01a3b670e4d6 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20956056-56a6-4542-8d5b-75f20b986f85 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:47 devstack sudo[99137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20956056-56a6-4542-8d5b-75f20b986f85 Jul 08 01:13:47 devstack sudo[99137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:47 devstack sudo[99139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:13:47 devstack sudo[99139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:48 devstack sudo[99139]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.675s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:48 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] Deleted volume successfully. Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-aed4abe1-c068-4ab9-a6cc-537e61b758f6 tempest-VolumesExtendTest-1417397802 None] Lock "cinder-63e5cb7f-1986-456e-a9f4-062ab29ad0eb-delete_volume" released by "delete_volume" :: held 3.597s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:48 devstack sudo[99137]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0f355929-dff7-4847-8ab6-01a3b670e4d6 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-20956056-56a6-4542-8d5b-75f20b986f85" returned: 0 in 0.776s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0f355929-dff7-4847-8ab6-01a3b670e4d6 tempest-VolumesGetTest-1383156073 None] Lock "cinder-quobyte-20956056-56a6-4542-8d5b-75f20b986f85" released by "delete_volume" :: held 1.666s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-0f355929-dff7-4847-8ab6-01a3b670e4d6 tempest-VolumesGetTest-1383156073 None] Created reservations ['6154884c-79d4-4240-9d96-144eda1f57ea', '02a7ceb1-62dc-433b-ad91-d99d225505e7', '2a8bb6d1-c27d-462c-9155-110a04a81011', 'cf776f42-031e-4b37-ae73-7222f1c8c7d6'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0f355929-dff7-4847-8ab6-01a3b670e4d6 tempest-VolumesGetTest-1383156073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0f355929-dff7-4847-8ab6-01a3b670e4d6 tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0f355929-dff7-4847-8ab6-01a3b670e4d6 tempest-VolumesGetTest-1383156073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0f355929-dff7-4847-8ab6-01a3b670e4d6 tempest-VolumesGetTest-1383156073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0f355929-dff7-4847-8ab6-01a3b670e4d6 tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0f355929-dff7-4847-8ab6-01a3b670e4d6 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:48 devstack sudo[99143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:13:48 devstack sudo[99143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Flow 'volume_create_manager' (f2cf4af6-3866-462f-8f34-e421f307f777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5baebf-139b-4d76-aa28-c82f49799bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5baebf-139b-4d76-aa28-c82f49799bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1911489814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e7db6c-5040-4c45-91e3-0af4072b16d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0bec86bef44a918bea26a9acae1350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:48Z,use_quota=True,user_id='cea1ed406bb64f1dbee53d406f9ec32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f1e7cf-0c0f-4bfb-8be5-41c915649cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68f1e7cf-0c0f-4bfb-8be5-41c915649cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5198d3-0d18-4a2a-944c-c15b2efdc196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5198d3-0d18-4a2a-944c-c15b2efdc196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2e7db6c-5040-4c45-91e3-0af4072b16d9', 'volume_name': 'volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7276727e-8170-4362-ac7e-ce86b1659cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7276727e-8170-4362-ac7e-ce86b1659cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a4a4b6-5526-432d-8b35-e2a7f8917779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:48 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Volume a2e7db6c-5040-4c45-91e3-0af4072b16d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9', 'volume_size': 1} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1911489814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e7db6c-5040-4c45-91e3-0af4072b16d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b0bec86bef44a918bea26a9acae1350',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:48Z,use_quota=True,user_id='cea1ed406bb64f1dbee53d406f9ec32e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Creating volume a2e7db6c-5040-4c45-91e3-0af4072b16d9 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:13:48 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:48 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9 1073741824 Jul 08 01:13:48 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b87f0366-507d-4664-98b4-9cacce32b5f6 tempest-VolumesGetTest-1383156073 None] Acquiring lock "cinder-e7056d27-e545-4e58-ace6-812c5f137846-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b87f0366-507d-4664-98b4-9cacce32b5f6 tempest-VolumesGetTest-1383156073 None] Lock "cinder-e7056d27-e545-4e58-ace6-812c5f137846-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b87f0366-507d-4664-98b4-9cacce32b5f6 tempest-VolumesGetTest-1383156073 None] Acquiring lock "cinder-quobyte-e7056d27-e545-4e58-ace6-812c5f137846" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b87f0366-507d-4664-98b4-9cacce32b5f6 tempest-VolumesGetTest-1383156073 None] Lock "cinder-quobyte-e7056d27-e545-4e58-ace6-812c5f137846" acquired by "delete_volume" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6192b5-0d7b-4945-8e2b-0cb0efe0bdc5]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b87f0366-507d-4664-98b4-9cacce32b5f6 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e7056d27-e545-4e58-ace6-812c5f137846 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:48 devstack sudo[99143]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0f355929-dff7-4847-8ab6-01a3b670e4d6 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.696s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-0f355929-dff7-4847-8ab6-01a3b670e4d6 tempest-VolumesGetTest-1383156073 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:48 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-0f355929-dff7-4847-8ab6-01a3b670e4d6 tempest-VolumesGetTest-1383156073 None] Deleted volume successfully. Jul 08 01:13:48 devstack sudo[99148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e7056d27-e545-4e58-ace6-812c5f137846 Jul 08 01:13:48 devstack sudo[99148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:48 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0f355929-dff7-4847-8ab6-01a3b670e4d6 tempest-VolumesGetTest-1383156073 None] Lock "cinder-20956056-56a6-4542-8d5b-75f20b986f85-delete_volume" released by "delete_volume" :: held 2.618s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:49 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9 1073741824" returned: 0 in 1.030s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:49 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9 Jul 08 01:13:49 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:49 devstack sudo[99148]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b87f0366-507d-4664-98b4-9cacce32b5f6 tempest-VolumesGetTest-1383156073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e7056d27-e545-4e58-ace6-812c5f137846" returned: 0 in 0.838s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b87f0366-507d-4664-98b4-9cacce32b5f6 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e7056d27-e545-4e58-ace6-812c5f137846 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:49 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e7056d27-e545-4e58-ace6-812c5f137846 Jul 08 01:13:49 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:50 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9" returned: 0 in 0.662s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:50 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:13:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.741s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:50 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0a4a4b6-5526-432d-8b35-e2a7f8917779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:50 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af793f7-e075-44e8-ad10-c734637b1424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:50 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Volume volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9 (a2e7db6c-5040-4c45-91e3-0af4072b16d9): created successfully Jul 08 01:13:50 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0af793f7-e075-44e8-ad10-c734637b1424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:50 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Flow 'volume_create_manager' (f2cf4af6-3866-462f-8f34-e421f307f777) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:50 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b4a8e119-90a3-4708-bc2f-c4ddbcc31633 tempest-VolumesExtendTest-1417397802 None] Created volume successfully. Jul 08 01:13:50 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b87f0366-507d-4664-98b4-9cacce32b5f6 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e7056d27-e545-4e58-ace6-812c5f137846" returned: 0 in 0.870s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:50 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b87f0366-507d-4664-98b4-9cacce32b5f6 tempest-VolumesGetTest-1383156073 None] Lock "cinder-quobyte-e7056d27-e545-4e58-ace6-812c5f137846" released by "delete_volume" :: held 1.763s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3ecd6725-3faf-43d9-8300-dffab1912f39 tempest-VolumesExtendTest-1417397802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3ecd6725-3faf-43d9-8300-dffab1912f39 tempest-VolumesExtendTest-1417397802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:50 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-b87f0366-507d-4664-98b4-9cacce32b5f6 tempest-VolumesGetTest-1383156073 None] Created reservations ['718cca7c-5720-4557-a30a-cb5f664aba9d', '7beb98a6-2672-455e-8e6d-2702b43c1b3c', '9b298f59-0312-439d-85a8-6068b24066f4', 'f6e19a11-3e35-4364-a7d4-972a22c0b6b5'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:50 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-3ecd6725-3faf-43d9-8300-dffab1912f39 tempest-VolumesExtendTest-1417397802 None] Creating offline snapshot 2066802a-2ba9-4b1e-9b07-e49be59b1e21 of volume a2e7db6c-5040-4c45-91e3-0af4072b16d9 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:13:50 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae186332-f2ef-4ee1-ad40-b19503c2d8e3]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3ecd6725-3faf-43d9-8300-dffab1912f39 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b87f0366-507d-4664-98b4-9cacce32b5f6 tempest-VolumesGetTest-1383156073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b87f0366-507d-4664-98b4-9cacce32b5f6 tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:50 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b87f0366-507d-4664-98b4-9cacce32b5f6 tempest-VolumesGetTest-1383156073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:50 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b87f0366-507d-4664-98b4-9cacce32b5f6 tempest-VolumesGetTest-1383156073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b87f0366-507d-4664-98b4-9cacce32b5f6 tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b87f0366-507d-4664-98b4-9cacce32b5f6 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:50 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:13:50 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:50 devstack sudo[99165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9 Jul 08 01:13:50 devstack sudo[99165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:51 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dcdefaaf-3b98-47e2-8266-38c9d7e3d3cb tempest-VolumesGetTest-1383156073 None] Acquiring lock "cinder-13f96fa0-9248-438b-a18f-a177a92619b2-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:51 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dcdefaaf-3b98-47e2-8266-38c9d7e3d3cb tempest-VolumesGetTest-1383156073 None] Lock "cinder-13f96fa0-9248-438b-a18f-a177a92619b2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:51 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dcdefaaf-3b98-47e2-8266-38c9d7e3d3cb tempest-VolumesGetTest-1383156073 None] Acquiring lock "cinder-quobyte-13f96fa0-9248-438b-a18f-a177a92619b2" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:51 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dcdefaaf-3b98-47e2-8266-38c9d7e3d3cb tempest-VolumesGetTest-1383156073 None] Lock "cinder-quobyte-13f96fa0-9248-438b-a18f-a177a92619b2" acquired by "delete_volume" :: waited 0.025s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:51 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43b9223-f9e6-4af7-a43b-b1e75840a762]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dcdefaaf-3b98-47e2-8266-38c9d7e3d3cb tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:51 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2 Jul 08 01:13:51 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:51 devstack sudo[99165]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3ecd6725-3faf-43d9-8300-dffab1912f39 tempest-VolumesExtendTest-1417397802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9" returned: 0 in 0.840s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3ecd6725-3faf-43d9-8300-dffab1912f39 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.2066802a-2ba9-4b1e-9b07-e49be59b1e21 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:51 devstack sudo[99175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.2066802a-2ba9-4b1e-9b07-e49be59b1e21 1G Jul 08 01:13:51 devstack sudo[99175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:51 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b87f0366-507d-4664-98b4-9cacce32b5f6 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.806s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:51 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-b87f0366-507d-4664-98b4-9cacce32b5f6 tempest-VolumesGetTest-1383156073 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:51 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b87f0366-507d-4664-98b4-9cacce32b5f6 tempest-VolumesGetTest-1383156073 None] Deleted volume successfully. Jul 08 01:13:51 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b87f0366-507d-4664-98b4-9cacce32b5f6 tempest-VolumesGetTest-1383156073 None] Lock "cinder-e7056d27-e545-4e58-ace6-812c5f137846-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:52 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dcdefaaf-3b98-47e2-8266-38c9d7e3d3cb tempest-VolumesGetTest-1383156073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2" returned: 0 in 0.808s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dcdefaaf-3b98-47e2-8266-38c9d7e3d3cb tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:52 devstack sudo[99180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2 Jul 08 01:13:52 devstack sudo[99180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:52 devstack sudo[99175]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3ecd6725-3faf-43d9-8300-dffab1912f39 tempest-VolumesExtendTest-1417397802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.2066802a-2ba9-4b1e-9b07-e49be59b1e21 1G" returned: 0 in 1.012s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3ecd6725-3faf-43d9-8300-dffab1912f39 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.2066802a-2ba9-4b1e-9b07-e49be59b1e21 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:52 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.2066802a-2ba9-4b1e-9b07-e49be59b1e21 Jul 08 01:13:52 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:52 devstack sudo[99180]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dcdefaaf-3b98-47e2-8266-38c9d7e3d3cb tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-13f96fa0-9248-438b-a18f-a177a92619b2" returned: 0 in 0.740s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dcdefaaf-3b98-47e2-8266-38c9d7e3d3cb tempest-VolumesGetTest-1383156073 None] Lock "cinder-quobyte-13f96fa0-9248-438b-a18f-a177a92619b2" released by "delete_volume" :: held 1.621s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:52 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-dcdefaaf-3b98-47e2-8266-38c9d7e3d3cb tempest-VolumesGetTest-1383156073 None] Created reservations ['82855428-88a6-4739-a000-4547a7bb8cd2', 'fee6c05a-4e1f-40da-9962-99623ee28eb8', 'c09c9a56-a8bd-4e61-95ce-7e85ca15f5a3', 'b6918d39-eacd-4ce0-abe2-09864f814c9a'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:13:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-dcdefaaf-3b98-47e2-8266-38c9d7e3d3cb tempest-VolumesGetTest-1383156073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-dcdefaaf-3b98-47e2-8266-38c9d7e3d3cb tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-dcdefaaf-3b98-47e2-8266-38c9d7e3d3cb tempest-VolumesGetTest-1383156073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-dcdefaaf-3b98-47e2-8266-38c9d7e3d3cb tempest-VolumesGetTest-1383156073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-dcdefaaf-3b98-47e2-8266-38c9d7e3d3cb tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dcdefaaf-3b98-47e2-8266-38c9d7e3d3cb tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:52 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:13:52 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:53 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3ecd6725-3faf-43d9-8300-dffab1912f39 tempest-VolumesExtendTest-1417397802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.2066802a-2ba9-4b1e-9b07-e49be59b1e21" returned: 0 in 0.897s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:53 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-3ecd6725-3faf-43d9-8300-dffab1912f39 tempest-VolumesExtendTest-1417397802 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.2066802a-2ba9-4b1e-9b07-e49be59b1e21 is being set with open permissions: ugo+rw Jul 08 01:13:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3ecd6725-3faf-43d9-8300-dffab1912f39 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.2066802a-2ba9-4b1e-9b07-e49be59b1e21 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:53 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.2066802a-2ba9-4b1e-9b07-e49be59b1e21 Jul 08 01:13:53 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:53 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-dcdefaaf-3b98-47e2-8266-38c9d7e3d3cb tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.719s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:53 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-dcdefaaf-3b98-47e2-8266-38c9d7e3d3cb tempest-VolumesGetTest-1383156073 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:13:53 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-dcdefaaf-3b98-47e2-8266-38c9d7e3d3cb tempest-VolumesGetTest-1383156073 None] Deleted volume successfully. Jul 08 01:13:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-dcdefaaf-3b98-47e2-8266-38c9d7e3d3cb tempest-VolumesGetTest-1383156073 None] Lock "cinder-13f96fa0-9248-438b-a18f-a177a92619b2-delete_volume" released by "delete_volume" :: held 2.602s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:13:54 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3ecd6725-3faf-43d9-8300-dffab1912f39 tempest-VolumesExtendTest-1417397802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.2066802a-2ba9-4b1e-9b07-e49be59b1e21" returned: 0 in 0.745s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3ecd6725-3faf-43d9-8300-dffab1912f39 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:54 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.info Jul 08 01:13:54 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:54 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:13:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Flow 'volume_create_manager' (a9460f4d-c8ba-49eb-9d46-2a196f654385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:13:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f67aa70c-2ecc-4c02-9300-4a25b045ef03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f67aa70c-2ecc-4c02-9300-4a25b045ef03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-843563978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7cd1432-1c42-4cd5-b86e-e5ff88124dfd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7a6f26dc7b994b93b6971961999c2024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:54Z,use_quota=True,user_id='d00eed277f2645bcb23874586fa7058a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6dd55fc-3a6d-4e6c-a566-fe146dcbac98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6dd55fc-3a6d-4e6c-a566-fe146dcbac98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d47b2bc-a170-4945-b063-14794cd610a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:54 devstack cinder-volume[87123]: DEBUG cinder.image.glance [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Creating Keystone auth plugin from conf {{(pid=87123) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:13:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d47b2bc-a170-4945-b063-14794cd610a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c7cd1432-1c42-4cd5-b86e-e5ff88124dfd', 'volume_name': 'volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd', 'volume_size': 1, 'image_id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '464063acafa44f9e90fd1bca62b64e8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'created_at': datetime.datetime(2026, 7, 7, 22, 51, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 51, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d345e03-e626-4d5e-b238-a516c7b82b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d345e03-e626-4d5e-b238-a516c7b82b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:13:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969979fe-3030-40f2-8f2f-a4a2a284eef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:13:54 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Volume c7cd1432-1c42-4cd5-b86e-e5ff88124dfd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd', 'volume_size': 1, 'image_id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '464063acafa44f9e90fd1bca62b64e8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'created_at': datetime.datetime(2026, 7, 7, 22, 51, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 51, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 01:13:54 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Trying to clone c7cd1432-1c42-4cd5-b86e-e5ff88124dfd from image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d at location (None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}]). {{(pid=87123) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:13:54 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3ecd6725-3faf-43d9-8300-dffab1912f39 tempest-VolumesExtendTest-1417397802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.info" returned: 0 in 0.748s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:54 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-3ecd6725-3faf-43d9-8300-dffab1912f39 tempest-VolumesExtendTest-1417397802 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.info is being set with open permissions: ugo+rw Jul 08 01:13:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3ecd6725-3faf-43d9-8300-dffab1912f39 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:55 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.info Jul 08 01:13:55 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:55 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_u1wcflqrdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:13:55 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Image download 20.69 MB at 20.69 MB/s Jul 08 01:13:55 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[7647b3ca-e974-46e0-95bc-b8aeb7eb5566]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_u1wcflqrdevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:55 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_u1wcflqrdevstack@QuobyteHD Jul 08 01:13:55 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:55 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3ecd6725-3faf-43d9-8300-dffab1912f39 tempest-VolumesExtendTest-1417397802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.info" returned: 0 in 0.711s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3ecd6725-3faf-43d9-8300-dffab1912f39 tempest-VolumesExtendTest-1417397802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.066s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:55 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-3ecd6725-3faf-43d9-8300-dffab1912f39 tempest-VolumesExtendTest-1417397802 None] Create snapshot completed successfully Jul 08 01:13:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b7d4a2dc-4917-402f-9ac8-7b44ee111d7d tempest-VolumesExtendTest-1417397802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b7d4a2dc-4917-402f-9ac8-7b44ee111d7d tempest-VolumesExtendTest-1417397802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:56 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[df450955-18e4-43fb-8428-14993d656d2a]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b7d4a2dc-4917-402f-9ac8-7b44ee111d7d tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:56 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_u1wcflqrdevstack@QuobyteHD" returned: 0 in 0.777s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:56 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Temporary image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d is fetched for user d00eed277f2645bcb23874586fa7058a. {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:13:56 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9 Jul 08 01:13:56 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:56 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[8629c7f0-2fd3-4361-80f1-196c8dd0b0ff]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_u1wcflqrdevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:56 devstack sudo[99214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_u1wcflqrdevstack@QuobyteHD Jul 08 01:13:56 devstack sudo[99214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:56 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b7d4a2dc-4917-402f-9ac8-7b44ee111d7d tempest-VolumesExtendTest-1417397802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9" returned: 0 in 0.767s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b7d4a2dc-4917-402f-9ac8-7b44ee111d7d tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.2066802a-2ba9-4b1e-9b07-e49be59b1e21 2G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b7d4a2dc-4917-402f-9ac8-7b44ee111d7d tempest-VolumesExtendTest-1417397802 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.2066802a-2ba9-4b1e-9b07-e49be59b1e21 2G" returned: 0 in 0.139s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b7d4a2dc-4917-402f-9ac8-7b44ee111d7d tempest-VolumesExtendTest-1417397802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.948s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:57 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b7d4a2dc-4917-402f-9ac8-7b44ee111d7d tempest-VolumesExtendTest-1417397802 None] Extend volume completed successfully. Jul 08 01:13:57 devstack sudo[99214]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_u1wcflqrdevstack@QuobyteHD" returned: 0 in 0.844s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-843563978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7cd1432-1c42-4cd5-b86e-e5ff88124dfd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='7a6f26dc7b994b93b6971961999c2024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:13:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:13:54Z,use_quota=True,user_id='d00eed277f2645bcb23874586fa7058a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Creating volume c7cd1432-1c42-4cd5-b86e-e5ff88124dfd {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:13:57 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:57 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd 1073741824 Jul 08 01:13:57 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3a248fdf-5612-47a9-88ab-5870af126f4d tempest-VolumesExtendTest-1417397802 None] Acquiring lock "cinder-2066802a-2ba9-4b1e-9b07-e49be59b1e21-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3a248fdf-5612-47a9-88ab-5870af126f4d tempest-VolumesExtendTest-1417397802 None] Lock "cinder-2066802a-2ba9-4b1e-9b07-e49be59b1e21-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3a248fdf-5612-47a9-88ab-5870af126f4d tempest-VolumesExtendTest-1417397802 None] Acquiring lock "cinder-quobyte-a2e7db6c-5040-4c45-91e3-0af4072b16d9" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3a248fdf-5612-47a9-88ab-5870af126f4d tempest-VolumesExtendTest-1417397802 None] Lock "cinder-quobyte-a2e7db6c-5040-4c45-91e3-0af4072b16d9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3a248fdf-5612-47a9-88ab-5870af126f4d tempest-VolumesExtendTest-1417397802 None] Acquiring lock "cinder-quobyte-2066802a-2ba9-4b1e-9b07-e49be59b1e21" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3a248fdf-5612-47a9-88ab-5870af126f4d tempest-VolumesExtendTest-1417397802 None] Lock "cinder-quobyte-2066802a-2ba9-4b1e-9b07-e49be59b1e21" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-3a248fdf-5612-47a9-88ab-5870af126f4d tempest-VolumesExtendTest-1417397802 None] Deleting offline snapshot 2066802a-2ba9-4b1e-9b07-e49be59b1e21 of volume a2e7db6c-5040-4c45-91e3-0af4072b16d9 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-3a248fdf-5612-47a9-88ab-5870af126f4d tempest-VolumesExtendTest-1417397802 None] snapshot_file for this snap is: volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.2066802a-2ba9-4b1e-9b07-e49be59b1e21 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[961f9c69-6bdd-4969-b67e-42ea6d534ef5]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3a248fdf-5612-47a9-88ab-5870af126f4d tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.2066802a-2ba9-4b1e-9b07-e49be59b1e21 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:57 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.2066802a-2ba9-4b1e-9b07-e49be59b1e21 Jul 08 01:13:57 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:57 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd 1073741824" returned: 0 in 0.917s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:58 devstack sudo[99233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd Jul 08 01:13:58 devstack sudo[99233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:58 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3a248fdf-5612-47a9-88ab-5870af126f4d tempest-VolumesExtendTest-1417397802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.2066802a-2ba9-4b1e-9b07-e49be59b1e21" returned: 0 in 0.848s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-3a248fdf-5612-47a9-88ab-5870af126f4d tempest-VolumesExtendTest-1417397802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:13:58 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c558097-94b5-4eba-ba71-7e5859f042db]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3a248fdf-5612-47a9-88ab-5870af126f4d tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:58 devstack sudo[99238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9 Jul 08 01:13:58 devstack sudo[99238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:58 devstack sudo[99233]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd" returned: 0 in 0.711s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] <== create_volume: return (1684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:13:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.687s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:13:58 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Attempting download of 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d ((None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}])) to volume c7cd1432-1c42-4cd5-b86e-e5ff88124dfd. {{(pid=87123) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:13:58 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[370741f7-2d3d-47f5-a4e3-696cbbb0d396]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:13:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_a_ysztvo {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:58 devstack sudo[99241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_a_ysztvo Jul 08 01:13:58 devstack sudo[99241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:59 devstack sudo[99238]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3a248fdf-5612-47a9-88ab-5870af126f4d tempest-VolumesExtendTest-1417397802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9" returned: 0 in 0.834s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3a248fdf-5612-47a9-88ab-5870af126f4d tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.2066802a-2ba9-4b1e-9b07-e49be59b1e21 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:59 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.2066802a-2ba9-4b1e-9b07-e49be59b1e21 Jul 08 01:13:59 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:59 devstack sudo[99241]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_a_ysztvo" returned: 0 in 0.792s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_a_ysztvo {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:59 devstack sudo[99250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_a_ysztvo Jul 08 01:13:59 devstack sudo[99250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:13:59 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Jul 08 01:13:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3a248fdf-5612-47a9-88ab-5870af126f4d tempest-VolumesExtendTest-1417397802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.2066802a-2ba9-4b1e-9b07-e49be59b1e21" returned: 0 in 0.801s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:13:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3a248fdf-5612-47a9-88ab-5870af126f4d tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.2066802a-2ba9-4b1e-9b07-e49be59b1e21 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:13:59 devstack sudo[99255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.2066802a-2ba9-4b1e-9b07-e49be59b1e21 Jul 08 01:13:59 devstack sudo[99255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:00 devstack sudo[99250]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_a_ysztvo" returned: 1 in 0.743s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_a_ysztvo' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:14:00 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba509bf-7af5-4026-b529-030e2149b9de]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_u1wcflqrdevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:00 devstack sudo[99259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_u1wcflqrdevstack@QuobyteHD Jul 08 01:14:00 devstack sudo[99259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:00 devstack sudo[99255]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3a248fdf-5612-47a9-88ab-5870af126f4d tempest-VolumesExtendTest-1417397802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9.2066802a-2ba9-4b1e-9b07-e49be59b1e21" returned: 0 in 0.639s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:00 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3a248fdf-5612-47a9-88ab-5870af126f4d tempest-VolumesExtendTest-1417397802 None] Lock "cinder-quobyte-2066802a-2ba9-4b1e-9b07-e49be59b1e21" released by "_delete_snapshot" :: held 3.249s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:00 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3a248fdf-5612-47a9-88ab-5870af126f4d tempest-VolumesExtendTest-1417397802 None] Lock "cinder-quobyte-a2e7db6c-5040-4c45-91e3-0af4072b16d9" released by "delete_snapshot" :: held 3.278s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:00 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-3a248fdf-5612-47a9-88ab-5870af126f4d tempest-VolumesExtendTest-1417397802 None] Created reservations ['1d5ceef1-8386-412f-a174-5e11c47e21d8', '3ccdc715-eae4-4a2c-9f49-f1670395087e', '7ff2cca0-4436-43d9-b118-7eb14cf6f128', '17c1e5a5-7d7d-45ad-a3ca-eb4b7c8f78e9'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:14:00 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-3a248fdf-5612-47a9-88ab-5870af126f4d tempest-VolumesExtendTest-1417397802 None] Delete snapshot completed successfully. Jul 08 01:14:00 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3a248fdf-5612-47a9-88ab-5870af126f4d tempest-VolumesExtendTest-1417397802 None] Lock "cinder-2066802a-2ba9-4b1e-9b07-e49be59b1e21-delete_snapshot" released by "delete_snapshot" :: held 3.443s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:01 devstack sudo[99259]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_u1wcflqrdevstack@QuobyteHD" returned: 0 in 0.741s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:01 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d was qcow2, converting to raw {{(pid=87123) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:14:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_u1wcflqrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:01 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_u1wcflqrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd Jul 08 01:14:01 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:01 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2183a32a-b00c-4dd1-bd91-40d7e1a236f6 tempest-VolumesExtendTest-1417397802 None] Acquiring lock "cinder-a2e7db6c-5040-4c45-91e3-0af4072b16d9-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:01 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2183a32a-b00c-4dd1-bd91-40d7e1a236f6 tempest-VolumesExtendTest-1417397802 None] Lock "cinder-a2e7db6c-5040-4c45-91e3-0af4072b16d9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:01 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2183a32a-b00c-4dd1-bd91-40d7e1a236f6 tempest-VolumesExtendTest-1417397802 None] Acquiring lock "cinder-quobyte-a2e7db6c-5040-4c45-91e3-0af4072b16d9" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:01 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2183a32a-b00c-4dd1-bd91-40d7e1a236f6 tempest-VolumesExtendTest-1417397802 None] Lock "cinder-quobyte-a2e7db6c-5040-4c45-91e3-0af4072b16d9" acquired by "delete_volume" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:01 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[8918ffee-ea9e-4c05-bb61-b6e6c8f8d895]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2183a32a-b00c-4dd1-bd91-40d7e1a236f6 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:01 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9 Jul 08 01:14:01 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:02 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2183a32a-b00c-4dd1-bd91-40d7e1a236f6 tempest-VolumesExtendTest-1417397802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9" returned: 0 in 0.884s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2183a32a-b00c-4dd1-bd91-40d7e1a236f6 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:02 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9 Jul 08 01:14:02 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:03 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_u1wcflqrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd" returned: 0 in 2.154s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:03 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_u1wcflqrdevstack@QuobyteHD, size 112.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:14:03 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Converted 112.00 MB image at 51.95 MB/s Jul 08 01:14:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:03 devstack sudo[99283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd 1G Jul 08 01:14:03 devstack sudo[99283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:03 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2183a32a-b00c-4dd1-bd91-40d7e1a236f6 tempest-VolumesExtendTest-1417397802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e7db6c-5040-4c45-91e3-0af4072b16d9" returned: 0 in 0.721s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2183a32a-b00c-4dd1-bd91-40d7e1a236f6 tempest-VolumesExtendTest-1417397802 None] Lock "cinder-quobyte-a2e7db6c-5040-4c45-91e3-0af4072b16d9" released by "delete_volume" :: held 1.674s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:03 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:INSERT=49,cinder:UPDATE=160,cinder:SELECT=124,cinder:DELETE=7 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:14:03 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=110,cinder:UPDATE=156,cinder:DELETE=18,cinder:INSERT=38 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:14:03 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-2183a32a-b00c-4dd1-bd91-40d7e1a236f6 tempest-VolumesExtendTest-1417397802 None] Created reservations ['5dad1673-6989-42c0-97e1-38d821aeba56', 'ad3ef8a6-0341-4ca0-bf3a-4056a66c3cbb', '92f21008-76f2-41c0-aeba-c6e84a2e3d3b', '06b9ba92-1b56-41a6-8ff8-c0ee825265fa'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:14:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2183a32a-b00c-4dd1-bd91-40d7e1a236f6 tempest-VolumesExtendTest-1417397802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2183a32a-b00c-4dd1-bd91-40d7e1a236f6 tempest-VolumesExtendTest-1417397802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:03 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2183a32a-b00c-4dd1-bd91-40d7e1a236f6 tempest-VolumesExtendTest-1417397802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:03 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2183a32a-b00c-4dd1-bd91-40d7e1a236f6 tempest-VolumesExtendTest-1417397802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2183a32a-b00c-4dd1-bd91-40d7e1a236f6 tempest-VolumesExtendTest-1417397802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2183a32a-b00c-4dd1-bd91-40d7e1a236f6 tempest-VolumesExtendTest-1417397802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:03 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:14:03 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:04 devstack sudo[99283]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd 1G" returned: 0 in 0.778s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:04 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b82af3-7344-4562-bf58-f23ab06d4ca1]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:04 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd Jul 08 01:14:04 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:04 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2183a32a-b00c-4dd1-bd91-40d7e1a236f6 tempest-VolumesExtendTest-1417397802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.728s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:04 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-2183a32a-b00c-4dd1-bd91-40d7e1a236f6 tempest-VolumesExtendTest-1417397802 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:14:04 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-2183a32a-b00c-4dd1-bd91-40d7e1a236f6 tempest-VolumesExtendTest-1417397802 None] Deleted volume successfully. Jul 08 01:14:04 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2183a32a-b00c-4dd1-bd91-40d7e1a236f6 tempest-VolumesExtendTest-1417397802 None] Lock "cinder-a2e7db6c-5040-4c45-91e3-0af4072b16d9-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:04 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd" returned: 0 in 0.828s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:05 devstack sudo[99295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd Jul 08 01:14:05 devstack sudo[99295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:05 devstack sudo[99295]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd" returned: 1 in 0.943s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:14:05 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Downloaded image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d ((None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}])) to volume c7cd1432-1c42-4cd5-b86e-e5ff88124dfd successfully. {{(pid=87123) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:14:05 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Temporary image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d for user d00eed277f2645bcb23874586fa7058a is deleted. {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:14:05 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Marking volume c7cd1432-1c42-4cd5-b86e-e5ff88124dfd as bootable. {{(pid=87123) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:14:05 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Copying metadata from image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d to c7cd1432-1c42-4cd5-b86e-e5ff88124dfd. {{(pid=87123) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:14:05 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Creating volume glance metadata for volume c7cd1432-1c42-4cd5-b86e-e5ff88124dfd backed by image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87123) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:14:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (969979fe-3030-40f2-8f2f-a4a2a284eef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd', 'volume_size': 1, 'image_id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '464063acafa44f9e90fd1bca62b64e8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'created_at': datetime.datetime(2026, 7, 7, 22, 51, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 51, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0150355a-24a6-4ba4-8c48-8e623b9b7156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:06 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Volume volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd (c7cd1432-1c42-4cd5-b86e-e5ff88124dfd): created successfully Jul 08 01:14:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0150355a-24a6-4ba4-8c48-8e623b9b7156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Flow 'volume_create_manager' (a9460f4d-c8ba-49eb-9d46-2a196f654385) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:06 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-3f90fb05-d9ad-4f7a-b458-bf9624f2d4a1 tempest-VolumesGetTest-1383156073 None] Created volume successfully. Jul 08 01:14:07 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:14:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Flow 'volume_create_manager' (bb85309b-b9a5-449f-b201-6e3221378ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d3d756-2d91-4616-84d3-21a4a9ea6029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d3d756-2d91-4616-84d3-21a4a9ea6029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1899902460',display_name='tempest-VolumesGetTest-Volume-635181800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81f8676a-0123-4878-86bd-b04410192a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6f26dc7b994b93b6971961999c2024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:07Z,use_quota=True,user_id='d00eed277f2645bcb23874586fa7058a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60af9203-34cd-440d-a807-3c1fd0aafe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60af9203-34cd-440d-a807-3c1fd0aafe9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de4e1c7-93cc-4ca1-ae4a-ef8f770c660e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6de4e1c7-93cc-4ca1-ae4a-ef8f770c660e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81f8676a-0123-4878-86bd-b04410192a64', 'volume_name': 'volume-81f8676a-0123-4878-86bd-b04410192a64', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4842301-f7b6-4357-8806-b757f0450000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4842301-f7b6-4357-8806-b757f0450000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f87ac4-3934-4806-a356-beeaad07dea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:07 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Volume 81f8676a-0123-4878-86bd-b04410192a64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81f8676a-0123-4878-86bd-b04410192a64', 'volume_size': 1} Jul 08 01:14:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1899902460',display_name='tempest-VolumesGetTest-Volume-635181800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81f8676a-0123-4878-86bd-b04410192a64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7a6f26dc7b994b93b6971961999c2024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:07Z,use_quota=True,user_id='d00eed277f2645bcb23874586fa7058a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:14:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Creating volume 81f8676a-0123-4878-86bd-b04410192a64 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:14:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:14:07 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:14:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-81f8676a-0123-4878-86bd-b04410192a64 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:07 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-81f8676a-0123-4878-86bd-b04410192a64 1073741824 Jul 08 01:14:07 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:08 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-81f8676a-0123-4878-86bd-b04410192a64 1073741824" returned: 0 in 1.022s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-81f8676a-0123-4878-86bd-b04410192a64 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:08 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-81f8676a-0123-4878-86bd-b04410192a64 Jul 08 01:14:08 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:08 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-81f8676a-0123-4878-86bd-b04410192a64" returned: 0 in 0.738s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] <== create_volume: return (1812ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:14:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f87ac4-3934-4806-a356-beeaad07dea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81f8676a-0123-4878-86bd-b04410192a64', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752d63a4-c2b1-42ac-b7a8-6af9c6499ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:09 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Volume volume-81f8676a-0123-4878-86bd-b04410192a64 (81f8676a-0123-4878-86bd-b04410192a64): created successfully Jul 08 01:14:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (752d63a4-c2b1-42ac-b7a8-6af9c6499ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Flow 'volume_create_manager' (bb85309b-b9a5-449f-b201-6e3221378ace) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:09 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-76fa0eeb-75ee-49e6-a53b-9582d59f30a2 tempest-VolumesGetTest-1383156073 None] Created volume successfully. Jul 08 01:14:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-cd20cb2f-0be7-4d19-9820-fd759af0b3f4 tempest-VolumesGetTest-1383156073 None] Acquiring lock "cinder-81f8676a-0123-4878-86bd-b04410192a64-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-cd20cb2f-0be7-4d19-9820-fd759af0b3f4 tempest-VolumesGetTest-1383156073 None] Lock "cinder-81f8676a-0123-4878-86bd-b04410192a64-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-cd20cb2f-0be7-4d19-9820-fd759af0b3f4 tempest-VolumesGetTest-1383156073 None] Acquiring lock "cinder-quobyte-81f8676a-0123-4878-86bd-b04410192a64" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-cd20cb2f-0be7-4d19-9820-fd759af0b3f4 tempest-VolumesGetTest-1383156073 None] Lock "cinder-quobyte-81f8676a-0123-4878-86bd-b04410192a64" acquired by "delete_volume" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:09 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed104ee-0ba0-4cf2-9929-6e74fcaf8b4a]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cd20cb2f-0be7-4d19-9820-fd759af0b3f4 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-81f8676a-0123-4878-86bd-b04410192a64 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:09 devstack sudo[99311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-81f8676a-0123-4878-86bd-b04410192a64 Jul 08 01:14:09 devstack sudo[99311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:10 devstack sudo[99311]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cd20cb2f-0be7-4d19-9820-fd759af0b3f4 tempest-VolumesGetTest-1383156073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-81f8676a-0123-4878-86bd-b04410192a64" returned: 0 in 0.865s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cd20cb2f-0be7-4d19-9820-fd759af0b3f4 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-81f8676a-0123-4878-86bd-b04410192a64 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:10 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-81f8676a-0123-4878-86bd-b04410192a64 Jul 08 01:14:10 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:11 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cd20cb2f-0be7-4d19-9820-fd759af0b3f4 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-81f8676a-0123-4878-86bd-b04410192a64" returned: 0 in 0.689s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:11 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-cd20cb2f-0be7-4d19-9820-fd759af0b3f4 tempest-VolumesGetTest-1383156073 None] Lock "cinder-quobyte-81f8676a-0123-4878-86bd-b04410192a64" released by "delete_volume" :: held 1.604s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:11 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-cd20cb2f-0be7-4d19-9820-fd759af0b3f4 tempest-VolumesGetTest-1383156073 None] Created reservations ['6c30885a-a6ab-4e18-be9e-c1a97195e1d3', '83aade2b-539c-42e0-9970-b2fd31ce3371', '1fdd3e82-33ce-4274-b053-992dbf3f82ca', '450a121a-b81a-4adb-b03a-ec7a5849ea92'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:14:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-cd20cb2f-0be7-4d19-9820-fd759af0b3f4 tempest-VolumesGetTest-1383156073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-cd20cb2f-0be7-4d19-9820-fd759af0b3f4 tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-cd20cb2f-0be7-4d19-9820-fd759af0b3f4 tempest-VolumesGetTest-1383156073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-cd20cb2f-0be7-4d19-9820-fd759af0b3f4 tempest-VolumesGetTest-1383156073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-cd20cb2f-0be7-4d19-9820-fd759af0b3f4 tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cd20cb2f-0be7-4d19-9820-fd759af0b3f4 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:11 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:14:11 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:11 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] Acquiring lock "cinder-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:11 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] Lock "cinder-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:11 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] Acquiring lock "cinder-quobyte-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:11 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] Lock "cinder-quobyte-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd" acquired by "delete_volume" :: waited 0.035s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:11 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a94515-9528-45e5-b3d7-d0b263121a20]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:11 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cd20cb2f-0be7-4d19-9820-fd759af0b3f4 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.762s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:11 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-cd20cb2f-0be7-4d19-9820-fd759af0b3f4 tempest-VolumesGetTest-1383156073 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:14:11 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-cd20cb2f-0be7-4d19-9820-fd759af0b3f4 tempest-VolumesGetTest-1383156073 None] Deleted volume successfully. Jul 08 01:14:12 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-cd20cb2f-0be7-4d19-9820-fd759af0b3f4 tempest-VolumesGetTest-1383156073 None] Lock "cinder-81f8676a-0123-4878-86bd-b04410192a64-delete_volume" released by "delete_volume" :: held 2.635s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:12 devstack sudo[99323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd Jul 08 01:14:12 devstack sudo[99323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:12 devstack sudo[99323]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd" returned: 0 in 0.892s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:12 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd Jul 08 01:14:12 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:13 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd" returned: 1 in 0.917s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:14:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:13 devstack sudo[99332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd Jul 08 01:14:13 devstack sudo[99332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:14 devstack sudo[99332]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd" returned: 0 in 0.835s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] Lock "cinder-quobyte-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd" released by "delete_volume" :: held 2.731s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:14 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] Created reservations ['6950a633-9841-4f8d-8107-1bb654911fdb', '0353371a-3455-4181-9f57-ce564526680a', 'fb30a63b-f603-47d9-ac28-3655d8b12458', 'cbf4fd40-327c-4294-b6c9-17c183a73e3a'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:14:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:14 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:14 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:14 devstack sudo[99369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:14:14 devstack sudo[99369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:15 devstack sudo[99369]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.975s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:15 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:14:15 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] Deleted volume successfully. Jul 08 01:14:15 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c0a829fb-0a89-4969-a565-3516b46aad65 tempest-VolumesGetTest-1383156073 None] Lock "cinder-c7cd1432-1c42-4cd5-b86e-e5ff88124dfd-delete_volume" released by "delete_volume" :: held 4.007s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:19 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:14:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Flow 'volume_create_manager' (3f7577b4-2f90-461b-9a81-aa9e570a29b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8442234b-0ecf-44a3-a3a5-3cccb9cd3e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8442234b-0ecf-44a3-a3a5-3cccb9cd3e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1954626320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2beecc2c-4f5c-4f2f-8fd5-05e08269629e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b25ea1db904bffb6f40722c6134c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:20Z,use_quota=True,user_id='f9b711530bb94dbfb30733e6a3a8f3bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b6f295-476b-4224-9575-3e4455cd92d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1b6f295-476b-4224-9575-3e4455cd92d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fbe70a3-185d-43ab-a08b-b110b9a020e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fbe70a3-185d-43ab-a08b-b110b9a020e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2beecc2c-4f5c-4f2f-8fd5-05e08269629e', 'volume_name': 'volume-2beecc2c-4f5c-4f2f-8fd5-05e08269629e', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4e14e1-45f1-42dd-9794-1b94994ae3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a4e14e1-45f1-42dd-9794-1b94994ae3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcfc8828-c11d-4fc6-9c52-234b8ee1d23c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:20 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Volume 2beecc2c-4f5c-4f2f-8fd5-05e08269629e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2beecc2c-4f5c-4f2f-8fd5-05e08269629e', 'volume_size': 1} Jul 08 01:14:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1954626320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2beecc2c-4f5c-4f2f-8fd5-05e08269629e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00b25ea1db904bffb6f40722c6134c14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:20Z,use_quota=True,user_id='f9b711530bb94dbfb30733e6a3a8f3bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:14:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Creating volume 2beecc2c-4f5c-4f2f-8fd5-05e08269629e {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:14:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:14:20 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:14:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2beecc2c-4f5c-4f2f-8fd5-05e08269629e 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:20 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2beecc2c-4f5c-4f2f-8fd5-05e08269629e 1073741824 Jul 08 01:14:20 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:21 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2beecc2c-4f5c-4f2f-8fd5-05e08269629e 1073741824" returned: 0 in 1.058s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2beecc2c-4f5c-4f2f-8fd5-05e08269629e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:21 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2beecc2c-4f5c-4f2f-8fd5-05e08269629e Jul 08 01:14:21 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:22 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2beecc2c-4f5c-4f2f-8fd5-05e08269629e" returned: 0 in 0.819s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:22 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] <== create_volume: return (1933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:14:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.936s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcfc8828-c11d-4fc6-9c52-234b8ee1d23c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2beecc2c-4f5c-4f2f-8fd5-05e08269629e', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d0933fb-88c8-40c2-a64f-1797d4a8a8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:22 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Volume volume-2beecc2c-4f5c-4f2f-8fd5-05e08269629e (2beecc2c-4f5c-4f2f-8fd5-05e08269629e): created successfully Jul 08 01:14:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d0933fb-88c8-40c2-a64f-1797d4a8a8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Flow 'volume_create_manager' (3f7577b4-2f90-461b-9a81-aa9e570a29b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:22 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-c281e987-e215-477d-b928-1fdce4f3ec0c tempest-VolumesNegativeTest-1386133665 None] Created volume successfully. Jul 08 01:14:32 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:INSERT=9,cinder:UPDATE=30,cinder:SELECT=23,cinder:DELETE=2 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:14:32 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=24,cinder:INSERT=17,cinder:UPDATE=33,cinder:DELETE=4 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:14:34 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:14:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Flow 'volume_create_manager' (81d3404b-a524-4506-88f5-39d436e6fcab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac7032f-d911-4681-b2d9-6ddd455f4bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ac7032f-d911-4681-b2d9-6ddd455f4bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-532972242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680f6502-e2e8-47a9-b8f7-7d0f197bdd8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='176b87e5227745db8a00fc5ef1e35135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:35Z,use_quota=True,user_id='84bdc7f2f943463bb56a492537771392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de09e904-f153-48ea-a29f-c62212c6a62b),volume_type_id=de09e904-f153-48ea-a29f-c62212c6a62b)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9074cf1-f3dc-4375-bbf8-193a82de0af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9074cf1-f3dc-4375-bbf8-193a82de0af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605a8878-cfda-4511-86ce-429cfe1c2658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605a8878-cfda-4511-86ce-429cfe1c2658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '680f6502-e2e8-47a9-b8f7-7d0f197bdd8d', 'volume_name': 'volume-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e032c4-7490-47d8-9a66-6a071e3ffce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83e032c4-7490-47d8-9a66-6a071e3ffce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9cd1e5-04fb-4205-825b-2ec0a091a19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:35 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Volume 680f6502-e2e8-47a9-b8f7-7d0f197bdd8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d', 'volume_size': 1} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-532972242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=680f6502-e2e8-47a9-b8f7-7d0f197bdd8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='176b87e5227745db8a00fc5ef1e35135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:35Z,use_quota=True,user_id='84bdc7f2f943463bb56a492537771392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de09e904-f153-48ea-a29f-c62212c6a62b),volume_type_id=de09e904-f153-48ea-a29f-c62212c6a62b)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Creating volume 680f6502-e2e8-47a9-b8f7-7d0f197bdd8d {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:14:35 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:35 devstack sudo[99411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d 1073741824 Jul 08 01:14:35 devstack sudo[99411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Flow 'volume_create_manager' (cf71e3ee-ba06-4d08-b68c-b79a5cbb2b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d6eae4-605a-4698-986f-559a4193ca7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70d6eae4-605a-4698-986f-559a4193ca7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2145528858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e11ff5-3705-45fb-9d04-20d87aaf1892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='176b87e5227745db8a00fc5ef1e35135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:35Z,use_quota=True,user_id='84bdc7f2f943463bb56a492537771392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(640234a6-83ee-4488-a263-98a4ccda97cc),volume_type_id=640234a6-83ee-4488-a263-98a4ccda97cc)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1722801d-aa6f-471d-aeb4-019977914180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1722801d-aa6f-471d-aeb4-019977914180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbb6242-8b56-4e27-b591-4241e707da47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fbb6242-8b56-4e27-b591-4241e707da47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2e11ff5-3705-45fb-9d04-20d87aaf1892', 'volume_name': 'volume-a2e11ff5-3705-45fb-9d04-20d87aaf1892', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d141c6-e3f2-4558-9543-b1a4e756861d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51d141c6-e3f2-4558-9543-b1a4e756861d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcaf1e84-7090-4470-aa16-2f773252cf9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:35 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Volume a2e11ff5-3705-45fb-9d04-20d87aaf1892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2e11ff5-3705-45fb-9d04-20d87aaf1892', 'volume_size': 1} Jul 08 01:14:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:36 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:14:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Flow 'volume_create_manager' (743c3d93-e4ae-45a7-8ac1-7d90d7e28eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ee08c0-ad23-4d61-b247-debf6d430c15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00ee08c0-ad23-4d61-b247-debf6d430c15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1483150662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='176b87e5227745db8a00fc5ef1e35135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:36Z,use_quota=True,user_id='84bdc7f2f943463bb56a492537771392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ed025ad-6016-406c-8caf-6c3c69928c6e),volume_type_id=3ed025ad-6016-406c-8caf-6c3c69928c6e)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f3ede0-8fc8-4a9c-b80e-526728346841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0f3ede0-8fc8-4a9c-b80e-526728346841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19c79bd-b701-46c3-8c21-0a136b04bb5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:36 devstack cinder-volume[87123]: DEBUG cinder.image.glance [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Creating Keystone auth plugin from conf {{(pid=87123) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:14:36 devstack sudo[99411]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d 1073741824" returned: 0 in 1.384s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:36 devstack sudo[99448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d Jul 08 01:14:36 devstack sudo[99448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f19c79bd-b701-46c3-8c21-0a136b04bb5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8', 'volume_name': 'volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8', 'volume_size': 1, 'image_id': '6318c361-4e02-4ac3-8ed2-f52e24c2a20c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6318c361-4e02-4ac3-8ed2-f52e24c2a20c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1251972506', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '176b87e5227745db8a00fc5ef1e35135', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6318c361-4e02-4ac3-8ed2-f52e24c2a20c', 'created_at': datetime.datetime(2026, 7, 7, 23, 14, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 14, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6318c361-4e02-4ac3-8ed2-f52e24c2a20c/file', 'properties': {}}, 'image_service': }' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b1f0711-022d-4898-9d91-92327eb8ede4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b1f0711-022d-4898-9d91-92327eb8ede4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb3ff15-5a6f-4ecc-b816-de943ab9e89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:36 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Volume 43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8', 'volume_size': 1, 'image_id': '6318c361-4e02-4ac3-8ed2-f52e24c2a20c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6318c361-4e02-4ac3-8ed2-f52e24c2a20c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1251972506', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '176b87e5227745db8a00fc5ef1e35135', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6318c361-4e02-4ac3-8ed2-f52e24c2a20c', 'created_at': datetime.datetime(2026, 7, 7, 23, 14, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 14, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6318c361-4e02-4ac3-8ed2-f52e24c2a20c/file', 'properties': {}}, 'image_service': } Jul 08 01:14:36 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Trying to clone 43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 from image 6318c361-4e02-4ac3-8ed2-f52e24c2a20c at location (None, [{'url': 'file:///opt/stack/data/glance/images/6318c361-4e02-4ac3-8ed2-f52e24c2a20c', 'metadata': {}}]). {{(pid=87123) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:14:37 devstack sudo[99448]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d" returned: 0 in 1.036s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] <== create_volume: return (2516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:14:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.518s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.102s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2145528858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e11ff5-3705-45fb-9d04-20d87aaf1892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='176b87e5227745db8a00fc5ef1e35135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:35Z,use_quota=True,user_id='84bdc7f2f943463bb56a492537771392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(640234a6-83ee-4488-a263-98a4ccda97cc),volume_type_id=640234a6-83ee-4488-a263-98a4ccda97cc)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:14:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Creating volume a2e11ff5-3705-45fb-9d04-20d87aaf1892 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:14:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:14:37 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:14:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e11ff5-3705-45fb-9d04-20d87aaf1892 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:37 devstack sudo[99466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e11ff5-3705-45fb-9d04-20d87aaf1892 1073741824 Jul 08 01:14:37 devstack sudo[99466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d9cd1e5-04fb-4205-825b-2ec0a091a19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8011375c-d897-4458-86dc-5bd213408f26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:37 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Volume volume-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d (680f6502-e2e8-47a9-b8f7-7d0f197bdd8d): created successfully Jul 08 01:14:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8011375c-d897-4458-86dc-5bd213408f26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:37 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Flow 'volume_create_manager' (81d3404b-a524-4506-88f5-39d436e6fcab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:37 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-ed4b8bbd-8545-4bdb-aced-62d547effd9d tempest-TestInstancesWithCinderVolumes-1157661349 None] Created volume successfully. Jul 08 01:14:38 devstack sudo[99466]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e11ff5-3705-45fb-9d04-20d87aaf1892 1073741824" returned: 0 in 1.056s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e11ff5-3705-45fb-9d04-20d87aaf1892 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:38 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e11ff5-3705-45fb-9d04-20d87aaf1892 Jul 08 01:14:38 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:39 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e11ff5-3705-45fb-9d04-20d87aaf1892" returned: 0 in 0.922s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:39 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] <== create_volume: return (2071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:14:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.074s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcaf1e84-7090-4470-aa16-2f773252cf9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e11ff5-3705-45fb-9d04-20d87aaf1892', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1650d7e-656d-4359-a678-7c078dd0cd0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:39 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Volume volume-a2e11ff5-3705-45fb-9d04-20d87aaf1892 (a2e11ff5-3705-45fb-9d04-20d87aaf1892): created successfully Jul 08 01:14:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1650d7e-656d-4359-a678-7c078dd0cd0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Flow 'volume_create_manager' (cf71e3ee-ba06-4d08-b68c-b79a5cbb2b61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:39 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f6fb0db9-00c5-47c8-abfe-c12695862fe0 tempest-TestInstancesWithCinderVolumes-1157661349 None] Created volume successfully. Jul 08 01:14:40 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6318c361-4e02-4ac3-8ed2-f52e24c2a20c_0b642vb1devstack@QuobyteHD, size 20.69 MB, duration 3.99 sec {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:14:40 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Image download 20.69 MB at 5.18 MB/s Jul 08 01:14:40 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c190a76-0be4-464a-abba-28d71a508799]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6318c361-4e02-4ac3-8ed2-f52e24c2a20c_0b642vb1devstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:41 devstack sudo[99498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6318c361-4e02-4ac3-8ed2-f52e24c2a20c_0b642vb1devstack@QuobyteHD Jul 08 01:14:41 devstack sudo[99498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:41 devstack sudo[99498]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6318c361-4e02-4ac3-8ed2-f52e24c2a20c_0b642vb1devstack@QuobyteHD" returned: 0 in 0.899s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:41 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Temporary image 6318c361-4e02-4ac3-8ed2-f52e24c2a20c is fetched for user 84bdc7f2f943463bb56a492537771392. {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:14:41 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a74352-92ee-4282-afef-a1b270c8adf3]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6318c361-4e02-4ac3-8ed2-f52e24c2a20c_0b642vb1devstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:42 devstack sudo[99503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6318c361-4e02-4ac3-8ed2-f52e24c2a20c_0b642vb1devstack@QuobyteHD Jul 08 01:14:42 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:42 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6318c361-4e02-4ac3-8ed2-f52e24c2a20c_0b642vb1devstack@QuobyteHD" returned: 0 in 0.890s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1483150662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='176b87e5227745db8a00fc5ef1e35135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:14:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:14:36Z,use_quota=True,user_id='84bdc7f2f943463bb56a492537771392',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3ed025ad-6016-406c-8caf-6c3c69928c6e),volume_type_id=3ed025ad-6016-406c-8caf-6c3c69928c6e)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:14:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Creating volume 43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:14:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:14:42 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:14:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:42 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 1073741824 Jul 08 01:14:42 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:43 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 1073741824" returned: 0 in 1.101s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:44 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 Jul 08 01:14:44 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:44 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8" returned: 0 in 0.722s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] <== create_volume: return (1880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:14:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.884s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:44 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Attempting download of 6318c361-4e02-4ac3-8ed2-f52e24c2a20c ((None, [{'url': 'file:///opt/stack/data/glance/images/6318c361-4e02-4ac3-8ed2-f52e24c2a20c', 'metadata': {}}])) to volume 43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8. {{(pid=87123) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:14:44 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb006c8-7bfe-4191-949c-156fdf5d0e59]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6318c361-4e02-4ac3-8ed2-f52e24c2a20c_9uhmpq5n {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:44 devstack sudo[99545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6318c361-4e02-4ac3-8ed2-f52e24c2a20c_9uhmpq5n Jul 08 01:14:44 devstack sudo[99545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:14:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:44 devstack sudo[99547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:14:44 devstack sudo[99547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:45 devstack sudo[99545]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6318c361-4e02-4ac3-8ed2-f52e24c2a20c_9uhmpq5n" returned: 0 in 0.753s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6318c361-4e02-4ac3-8ed2-f52e24c2a20c_9uhmpq5n {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:45 devstack sudo[99547]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.664s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:45 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:14:45 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:14:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 28 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:14:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:14:45 devstack sudo[99552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6318c361-4e02-4ac3-8ed2-f52e24c2a20c_9uhmpq5n Jul 08 01:14:45 devstack sudo[99552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:46 devstack sudo[99552]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6318c361-4e02-4ac3-8ed2-f52e24c2a20c_9uhmpq5n" returned: 1 in 0.849s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6318c361-4e02-4ac3-8ed2-f52e24c2a20c_9uhmpq5n' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:14:46 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ec150f-ce0d-4341-88ae-7f066c804f2c]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6318c361-4e02-4ac3-8ed2-f52e24c2a20c_0b642vb1devstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:46 devstack sudo[99556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6318c361-4e02-4ac3-8ed2-f52e24c2a20c_0b642vb1devstack@QuobyteHD Jul 08 01:14:46 devstack sudo[99556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:47 devstack sudo[99556]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_6318c361-4e02-4ac3-8ed2-f52e24c2a20c_0b642vb1devstack@QuobyteHD" returned: 0 in 0.783s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:47 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] 6318c361-4e02-4ac3-8ed2-f52e24c2a20c was qcow2, converting to raw {{(pid=87123) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:14:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6318c361-4e02-4ac3-8ed2-f52e24c2a20c_0b642vb1devstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:47 devstack sudo[99561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6318c361-4e02-4ac3-8ed2-f52e24c2a20c_0b642vb1devstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 Jul 08 01:14:47 devstack sudo[99561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:49 devstack sudo[99561]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_6318c361-4e02-4ac3-8ed2-f52e24c2a20c_0b642vb1devstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8" returned: 0 in 2.079s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:49 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6318c361-4e02-4ac3-8ed2-f52e24c2a20c_0b642vb1devstack@QuobyteHD, size 112.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:14:49 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Converted 112.00 MB image at 53.82 MB/s Jul 08 01:14:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:49 devstack sudo[99574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 1G Jul 08 01:14:49 devstack sudo[99574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:50 devstack sudo[99574]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 1G" returned: 0 in 0.766s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:50 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ae72ad-c468-46f4-bc28-25d92b43ca9a]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:50 devstack sudo[99579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 Jul 08 01:14:50 devstack sudo[99579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:51 devstack sudo[99579]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8" returned: 0 in 0.900s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:51 devstack sudo[99584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 Jul 08 01:14:51 devstack sudo[99584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:51 devstack sudo[99584]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8" returned: 1 in 0.941s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:14:51 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Downloaded image 6318c361-4e02-4ac3-8ed2-f52e24c2a20c ((None, [{'url': 'file:///opt/stack/data/glance/images/6318c361-4e02-4ac3-8ed2-f52e24c2a20c', 'metadata': {}}])) to volume 43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 successfully. {{(pid=87123) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:14:51 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Temporary image 6318c361-4e02-4ac3-8ed2-f52e24c2a20c for user 84bdc7f2f943463bb56a492537771392 is deleted. {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:14:51 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Marking volume 43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 as bootable. {{(pid=87123) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:14:51 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Copying metadata from image 6318c361-4e02-4ac3-8ed2-f52e24c2a20c to 43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8. {{(pid=87123) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:14:51 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Creating volume glance metadata for volume 43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 backed by image 6318c361-4e02-4ac3-8ed2-f52e24c2a20c with: {'image_id': '6318c361-4e02-4ac3-8ed2-f52e24c2a20c', 'image_name': 'tempest-scenario-img--1251972506', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87123) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:14:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abb3ff15-5a6f-4ecc-b816-de943ab9e89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8', 'volume_size': 1, 'image_id': '6318c361-4e02-4ac3-8ed2-f52e24c2a20c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6318c361-4e02-4ac3-8ed2-f52e24c2a20c', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1251972506', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '176b87e5227745db8a00fc5ef1e35135', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '6318c361-4e02-4ac3-8ed2-f52e24c2a20c', 'created_at': datetime.datetime(2026, 7, 7, 23, 14, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 14, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6318c361-4e02-4ac3-8ed2-f52e24c2a20c/file', 'properties': {}}, 'image_service': }' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02b62d4-efe0-4d48-9192-f5c67a3fb76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:14:52 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Volume volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 (43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8): created successfully Jul 08 01:14:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b02b62d4-efe0-4d48-9192-f5c67a3fb76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:14:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Flow 'volume_create_manager' (743c3d93-e4ae-45a7-8ac1-7d90d7e28eb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:14:52 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-39233cc9-42a9-4e18-b869-84a97b1fdcdc tempest-TestInstancesWithCinderVolumes-1157661349 None] Created volume successfully. Jul 08 01:14:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6f28f890-9db3-4c6f-b842-f2e9bbabcd52 tempest-VolumesNegativeTest-1386133665 None] Acquiring lock "cinder-2beecc2c-4f5c-4f2f-8fd5-05e08269629e-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6f28f890-9db3-4c6f-b842-f2e9bbabcd52 tempest-VolumesNegativeTest-1386133665 None] Lock "cinder-2beecc2c-4f5c-4f2f-8fd5-05e08269629e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6f28f890-9db3-4c6f-b842-f2e9bbabcd52 tempest-VolumesNegativeTest-1386133665 None] Acquiring lock "cinder-quobyte-2beecc2c-4f5c-4f2f-8fd5-05e08269629e" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:14:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6f28f890-9db3-4c6f-b842-f2e9bbabcd52 tempest-VolumesNegativeTest-1386133665 None] Lock "cinder-quobyte-2beecc2c-4f5c-4f2f-8fd5-05e08269629e" acquired by "delete_volume" :: waited 0.015s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:14:55 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc76986-4907-4d21-adf4-04569b7595f4]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6f28f890-9db3-4c6f-b842-f2e9bbabcd52 tempest-VolumesNegativeTest-1386133665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2beecc2c-4f5c-4f2f-8fd5-05e08269629e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:55 devstack sudo[99594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2beecc2c-4f5c-4f2f-8fd5-05e08269629e Jul 08 01:14:55 devstack sudo[99594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:56 devstack sudo[99594]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6f28f890-9db3-4c6f-b842-f2e9bbabcd52 tempest-VolumesNegativeTest-1386133665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2beecc2c-4f5c-4f2f-8fd5-05e08269629e" returned: 0 in 0.805s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6f28f890-9db3-4c6f-b842-f2e9bbabcd52 tempest-VolumesNegativeTest-1386133665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2beecc2c-4f5c-4f2f-8fd5-05e08269629e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:56 devstack sudo[99599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2beecc2c-4f5c-4f2f-8fd5-05e08269629e Jul 08 01:14:56 devstack sudo[99599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:57 devstack sudo[99599]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6f28f890-9db3-4c6f-b842-f2e9bbabcd52 tempest-VolumesNegativeTest-1386133665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2beecc2c-4f5c-4f2f-8fd5-05e08269629e" returned: 0 in 0.661s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6f28f890-9db3-4c6f-b842-f2e9bbabcd52 tempest-VolumesNegativeTest-1386133665 None] Lock "cinder-quobyte-2beecc2c-4f5c-4f2f-8fd5-05e08269629e" released by "delete_volume" :: held 1.513s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:57 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-6f28f890-9db3-4c6f-b842-f2e9bbabcd52 tempest-VolumesNegativeTest-1386133665 None] Created reservations ['5388d4b9-dfb0-4b18-a1fc-3496d71f3f18', 'c42b2f62-cf73-40c5-923c-597cfd425aed', '17679151-ef46-4b18-8c90-0f2b408c6b88', '80baaeaa-0a7a-4381-a8f4-6639a0fc9bb0'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:14:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6f28f890-9db3-4c6f-b842-f2e9bbabcd52 tempest-VolumesNegativeTest-1386133665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6f28f890-9db3-4c6f-b842-f2e9bbabcd52 tempest-VolumesNegativeTest-1386133665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:57 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6f28f890-9db3-4c6f-b842-f2e9bbabcd52 tempest-VolumesNegativeTest-1386133665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:14:57 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6f28f890-9db3-4c6f-b842-f2e9bbabcd52 tempest-VolumesNegativeTest-1386133665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:14:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6f28f890-9db3-4c6f-b842-f2e9bbabcd52 tempest-VolumesNegativeTest-1386133665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:14:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6f28f890-9db3-4c6f-b842-f2e9bbabcd52 tempest-VolumesNegativeTest-1386133665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:57 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:14:57 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:14:57 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Jul 08 01:14:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6f28f890-9db3-4c6f-b842-f2e9bbabcd52 tempest-VolumesNegativeTest-1386133665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.760s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:14:57 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-6f28f890-9db3-4c6f-b842-f2e9bbabcd52 tempest-VolumesNegativeTest-1386133665 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:14:58 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-6f28f890-9db3-4c6f-b842-f2e9bbabcd52 tempest-VolumesNegativeTest-1386133665 None] Deleted volume successfully. Jul 08 01:14:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6f28f890-9db3-4c6f-b842-f2e9bbabcd52 tempest-VolumesNegativeTest-1386133665 None] Lock "cinder-2beecc2c-4f5c-4f2f-8fd5-05e08269629e-delete_volume" released by "delete_volume" :: held 2.496s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:14:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-1a45db2f-d0d9-4761-bf6b-eb79db1b3e7e req-0a942537-24a2-4e53-b87a-2bd55d3d32db tempest-TestInstancesWithCinderVolumes-1157661349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:14:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-1a45db2f-d0d9-4761-bf6b-eb79db1b3e7e req-0a942537-24a2-4e53-b87a-2bd55d3d32db tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:14:59 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3523dd-22bd-42f5-b784-ad635d87ee33]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:14:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-1a45db2f-d0d9-4761-bf6b-eb79db1b3e7e req-0a942537-24a2-4e53-b87a-2bd55d3d32db tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:14:59 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 Jul 08 01:14:59 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:00 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-1a45db2f-d0d9-4761-bf6b-eb79db1b3e7e req-0a942537-24a2-4e53-b87a-2bd55d3d32db tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8" returned: 0 in 0.908s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-1a45db2f-d0d9-4761-bf6b-eb79db1b3e7e req-0a942537-24a2-4e53-b87a-2bd55d3d32db tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:00 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 Jul 08 01:15:00 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:01 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-1a45db2f-d0d9-4761-bf6b-eb79db1b3e7e req-0a942537-24a2-4e53-b87a-2bd55d3d32db tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8" returned: 1 in 0.883s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-1a45db2f-d0d9-4761-bf6b-eb79db1b3e7e req-0a942537-24a2-4e53-b87a-2bd55d3d32db tempest-TestInstancesWithCinderVolumes-1157661349 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:15:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-1a45db2f-d0d9-4761-bf6b-eb79db1b3e7e req-0a942537-24a2-4e53-b87a-2bd55d3d32db tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.847s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-1a45db2f-d0d9-4761-bf6b-eb79db1b3e7e req-0a942537-24a2-4e53-b87a-2bd55d3d32db tempest-TestInstancesWithCinderVolumes-1157661349 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e', 'name': 'volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1215bf9e-aa25-44d8-97b8-e43159940a26', 'enforce_multipath': True} {{(pid=87123) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:15:01 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-1a45db2f-d0d9-4761-bf6b-eb79db1b3e7e req-0a942537-24a2-4e53-b87a-2bd55d3d32db tempest-TestInstancesWithCinderVolumes-1157661349 None] attachment_update completed successfully. Jul 08 01:15:11 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:UPDATE=22,cinder:SELECT=22,cinder:DELETE=2,cinder:INSERT=8 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:15:11 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=23,cinder:UPDATE=19,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:15:12 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:15:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Flow 'volume_create_manager' (8ffcefbb-359f-407d-a8f2-605a93d8d5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fa03572-528d-4f11-88b0-bbf2628eddc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fa03572-528d-4f11-88b0-bbf2628eddc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-334150174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7dccab-28d6-41d4-9bee-37fa834f5cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bab65cd41a46a4bddb667016a620da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:13Z,use_quota=True,user_id='8b285ba96fbc49cd881fde73777b77f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc6c1fa-4c09-49fa-8040-e32c45466652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dc6c1fa-4c09-49fa-8040-e32c45466652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6906cbaa-c145-4d3c-a3c4-9bddc3614e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6906cbaa-c145-4d3c-a3c4-9bddc3614e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f7dccab-28d6-41d4-9bee-37fa834f5cf5', 'volume_name': 'volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2121f55-7c45-44c6-a7c2-fae23d8e15e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2121f55-7c45-44c6-a7c2-fae23d8e15e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7df8fe3-e579-4cce-af51-866958ca8e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:12 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Volume 9f7dccab-28d6-41d4-9bee-37fa834f5cf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5', 'volume_size': 1} Jul 08 01:15:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-334150174',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f7dccab-28d6-41d4-9bee-37fa834f5cf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bab65cd41a46a4bddb667016a620da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:13Z,use_quota=True,user_id='8b285ba96fbc49cd881fde73777b77f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:15:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Creating volume 9f7dccab-28d6-41d4-9bee-37fa834f5cf5 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:15:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:15:12 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:15:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:12 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5 1073741824 Jul 08 01:15:12 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:13 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5 1073741824" returned: 0 in 1.173s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:13 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5 Jul 08 01:15:13 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:14 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5" returned: 0 in 0.972s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:14 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] <== create_volume: return (2204ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:15:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.207s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:14 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7df8fe3-e579-4cce-af51-866958ca8e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:14 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3479f1-a89f-48f7-83fc-d848908745ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:14 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Volume volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5 (9f7dccab-28d6-41d4-9bee-37fa834f5cf5): created successfully Jul 08 01:15:14 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3479f1-a89f-48f7-83fc-d848908745ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:14 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Flow 'volume_create_manager' (8ffcefbb-359f-407d-a8f2-605a93d8d5ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:15 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-143ec08f-5d53-46cb-9231-b57efc6cfa72 tempest-VolumesSnapshotTestJSON-6837556 None] Created volume successfully. Jul 08 01:15:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3139ead0-85f9-4094-98a3-0ed664651154 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3139ead0-85f9-4094-98a3-0ed664651154 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-3139ead0-85f9-4094-98a3-0ed664651154 tempest-VolumesSnapshotTestJSON-6837556 None] Creating offline snapshot 470f170f-508e-4533-b557-d598d0ac1ca3 of volume 9f7dccab-28d6-41d4-9bee-37fa834f5cf5 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:15:16 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[e560a303-00cd-4138-be01-a8cd199d12a8]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3139ead0-85f9-4094-98a3-0ed664651154 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:16 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5 Jul 08 01:15:16 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:16 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3139ead0-85f9-4094-98a3-0ed664651154 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5" returned: 0 in 0.855s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3139ead0-85f9-4094-98a3-0ed664651154 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.470f170f-508e-4533-b557-d598d0ac1ca3 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:17 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.470f170f-508e-4533-b557-d598d0ac1ca3 1G Jul 08 01:15:17 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:18 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3139ead0-85f9-4094-98a3-0ed664651154 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.470f170f-508e-4533-b557-d598d0ac1ca3 1G" returned: 0 in 1.111s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3139ead0-85f9-4094-98a3-0ed664651154 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.470f170f-508e-4533-b557-d598d0ac1ca3 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:18 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.470f170f-508e-4533-b557-d598d0ac1ca3 Jul 08 01:15:18 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:18 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3139ead0-85f9-4094-98a3-0ed664651154 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.470f170f-508e-4533-b557-d598d0ac1ca3" returned: 0 in 0.750s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:18 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-3139ead0-85f9-4094-98a3-0ed664651154 tempest-VolumesSnapshotTestJSON-6837556 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.470f170f-508e-4533-b557-d598d0ac1ca3 is being set with open permissions: ugo+rw Jul 08 01:15:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3139ead0-85f9-4094-98a3-0ed664651154 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.470f170f-508e-4533-b557-d598d0ac1ca3 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:18 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.470f170f-508e-4533-b557-d598d0ac1ca3 Jul 08 01:15:18 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:19 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3139ead0-85f9-4094-98a3-0ed664651154 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.470f170f-508e-4533-b557-d598d0ac1ca3" returned: 0 in 0.677s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3139ead0-85f9-4094-98a3-0ed664651154 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:19 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.info Jul 08 01:15:19 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:20 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3139ead0-85f9-4094-98a3-0ed664651154 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.info" returned: 0 in 0.714s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:20 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-3139ead0-85f9-4094-98a3-0ed664651154 tempest-VolumesSnapshotTestJSON-6837556 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.info is being set with open permissions: ugo+rw Jul 08 01:15:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3139ead0-85f9-4094-98a3-0ed664651154 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:20 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.info Jul 08 01:15:20 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:20 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3139ead0-85f9-4094-98a3-0ed664651154 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.info" returned: 0 in 0.687s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3139ead0-85f9-4094-98a3-0ed664651154 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.906s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:21 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-3139ead0-85f9-4094-98a3-0ed664651154 tempest-VolumesSnapshotTestJSON-6837556 None] Create snapshot completed successfully Jul 08 01:15:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f69ed218-c2ba-4b79-bdaa-c1b0a2d4a8ec tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-470f170f-508e-4533-b557-d598d0ac1ca3-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f69ed218-c2ba-4b79-bdaa-c1b0a2d4a8ec tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-470f170f-508e-4533-b557-d598d0ac1ca3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f69ed218-c2ba-4b79-bdaa-c1b0a2d4a8ec tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-quobyte-9f7dccab-28d6-41d4-9bee-37fa834f5cf5" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f69ed218-c2ba-4b79-bdaa-c1b0a2d4a8ec tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-9f7dccab-28d6-41d4-9bee-37fa834f5cf5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f69ed218-c2ba-4b79-bdaa-c1b0a2d4a8ec tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-quobyte-470f170f-508e-4533-b557-d598d0ac1ca3" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f69ed218-c2ba-4b79-bdaa-c1b0a2d4a8ec tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-470f170f-508e-4533-b557-d598d0ac1ca3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f69ed218-c2ba-4b79-bdaa-c1b0a2d4a8ec tempest-VolumesSnapshotTestJSON-6837556 None] Deleting offline snapshot 470f170f-508e-4533-b557-d598d0ac1ca3 of volume 9f7dccab-28d6-41d4-9bee-37fa834f5cf5 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:15:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f69ed218-c2ba-4b79-bdaa-c1b0a2d4a8ec tempest-VolumesSnapshotTestJSON-6837556 None] snapshot_file for this snap is: volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.470f170f-508e-4533-b557-d598d0ac1ca3 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:15:21 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[08327026-ecb4-4193-b68b-2542323a4995]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f69ed218-c2ba-4b79-bdaa-c1b0a2d4a8ec tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.470f170f-508e-4533-b557-d598d0ac1ca3 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:21 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.470f170f-508e-4533-b557-d598d0ac1ca3 Jul 08 01:15:21 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:22 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f69ed218-c2ba-4b79-bdaa-c1b0a2d4a8ec tempest-VolumesSnapshotTestJSON-6837556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.470f170f-508e-4533-b557-d598d0ac1ca3" returned: 0 in 0.779s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:22 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f69ed218-c2ba-4b79-bdaa-c1b0a2d4a8ec tempest-VolumesSnapshotTestJSON-6837556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:15:22 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[116c2315-4af0-48e3-b00c-e35ad1303d8c]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f69ed218-c2ba-4b79-bdaa-c1b0a2d4a8ec tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:22 devstack sudo[100164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5 Jul 08 01:15:22 devstack sudo[100164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:23 devstack sudo[100164]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f69ed218-c2ba-4b79-bdaa-c1b0a2d4a8ec tempest-VolumesSnapshotTestJSON-6837556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5" returned: 0 in 0.867s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f69ed218-c2ba-4b79-bdaa-c1b0a2d4a8ec tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.470f170f-508e-4533-b557-d598d0ac1ca3 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:23 devstack sudo[100170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.470f170f-508e-4533-b557-d598d0ac1ca3 Jul 08 01:15:23 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:24 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f69ed218-c2ba-4b79-bdaa-c1b0a2d4a8ec tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.470f170f-508e-4533-b557-d598d0ac1ca3" returned: 0 in 0.835s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f69ed218-c2ba-4b79-bdaa-c1b0a2d4a8ec tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.470f170f-508e-4533-b557-d598d0ac1ca3 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:24 devstack sudo[100263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.470f170f-508e-4533-b557-d598d0ac1ca3 Jul 08 01:15:24 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:24 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f69ed218-c2ba-4b79-bdaa-c1b0a2d4a8ec tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5.470f170f-508e-4533-b557-d598d0ac1ca3" returned: 0 in 0.686s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f69ed218-c2ba-4b79-bdaa-c1b0a2d4a8ec tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-470f170f-508e-4533-b557-d598d0ac1ca3" released by "_delete_snapshot" :: held 3.272s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f69ed218-c2ba-4b79-bdaa-c1b0a2d4a8ec tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-9f7dccab-28d6-41d4-9bee-37fa834f5cf5" released by "delete_snapshot" :: held 3.293s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:24 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-f69ed218-c2ba-4b79-bdaa-c1b0a2d4a8ec tempest-VolumesSnapshotTestJSON-6837556 None] Created reservations ['210d9c5a-36c1-425b-ae5d-ffdfbf87d0b3', 'd66168f9-d342-4b53-9fcb-509e17fae097', '179f81a6-5b65-475b-81cf-881e263f6177', '99086987-56d6-40fe-b34c-91ddf3f44eb5'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:15:24 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f69ed218-c2ba-4b79-bdaa-c1b0a2d4a8ec tempest-VolumesSnapshotTestJSON-6837556 None] Delete snapshot completed successfully. Jul 08 01:15:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f69ed218-c2ba-4b79-bdaa-c1b0a2d4a8ec tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-470f170f-508e-4533-b557-d598d0ac1ca3-delete_snapshot" released by "delete_snapshot" :: held 3.469s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:26 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:15:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Flow 'volume_create_manager' (d84027c3-9cd9-410b-9825-bac25e1bcbf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5eb34d6-57b3-4f62-ba65-115d21dfd657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5eb34d6-57b3-4f62-ba65-115d21dfd657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2040532253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9035189a-56a0-4b07-9a27-3134343ca4f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bab65cd41a46a4bddb667016a620da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:26Z,use_quota=True,user_id='8b285ba96fbc49cd881fde73777b77f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dedc86c-d38b-4610-a251-d6c8653cc033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dedc86c-d38b-4610-a251-d6c8653cc033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5935c0-cf48-41ac-a048-accd63a2647f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f5935c0-cf48-41ac-a048-accd63a2647f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9035189a-56a0-4b07-9a27-3134343ca4f5', 'volume_name': 'volume-9035189a-56a0-4b07-9a27-3134343ca4f5', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9122f94-d600-49be-91bb-9368c628d201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9122f94-d600-49be-91bb-9368c628d201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0eb7e2-8d86-4c0f-acfc-087a8a2e2b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:26 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Volume 9035189a-56a0-4b07-9a27-3134343ca4f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9035189a-56a0-4b07-9a27-3134343ca4f5', 'volume_size': 1} Jul 08 01:15:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:26 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2040532253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9035189a-56a0-4b07-9a27-3134343ca4f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bab65cd41a46a4bddb667016a620da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:26Z,use_quota=True,user_id='8b285ba96fbc49cd881fde73777b77f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:15:26 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Creating volume 9035189a-56a0-4b07-9a27-3134343ca4f5 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:15:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:26 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:26 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:26 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:15:26 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:15:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:26 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5 1073741824 Jul 08 01:15:26 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:27 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5 1073741824" returned: 0 in 1.001s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:27 devstack sudo[100272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5 Jul 08 01:15:27 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:28 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5" returned: 0 in 0.736s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:28 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:15:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.787s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc0eb7e2-8d86-4c0f-acfc-087a8a2e2b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9035189a-56a0-4b07-9a27-3134343ca4f5', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c74258-b776-4fe8-8169-2f74637a6ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:28 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Volume volume-9035189a-56a0-4b07-9a27-3134343ca4f5 (9035189a-56a0-4b07-9a27-3134343ca4f5): created successfully Jul 08 01:15:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c74258-b776-4fe8-8169-2f74637a6ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Flow 'volume_create_manager' (d84027c3-9cd9-410b-9825-bac25e1bcbf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:28 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b87882a6-247a-4b19-8295-08697ccba9c9 tempest-VolumesSnapshotTestJSON-6837556 None] Created volume successfully. Jul 08 01:15:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-08f0def3-17b2-4d04-ae37-dcc16b4b8a9f tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-08f0def3-17b2-4d04-ae37-dcc16b4b8a9f tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:28 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-08f0def3-17b2-4d04-ae37-dcc16b4b8a9f tempest-VolumesSnapshotTestJSON-6837556 None] Creating offline snapshot c8367cf0-72d1-4c8f-bda9-897d41e55fb6 of volume 9035189a-56a0-4b07-9a27-3134343ca4f5 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:15:28 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2159e77-0971-440b-8a74-b3a1274a218a]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-08f0def3-17b2-4d04-ae37-dcc16b4b8a9f tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:28 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5 Jul 08 01:15:28 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:29 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-08f0def3-17b2-4d04-ae37-dcc16b4b8a9f tempest-VolumesSnapshotTestJSON-6837556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5" returned: 0 in 0.908s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-08f0def3-17b2-4d04-ae37-dcc16b4b8a9f tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:29 devstack sudo[100280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6 1G Jul 08 01:15:29 devstack sudo[100280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:30 devstack sudo[100280]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-08f0def3-17b2-4d04-ae37-dcc16b4b8a9f tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6 1G" returned: 0 in 1.088s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-08f0def3-17b2-4d04-ae37-dcc16b4b8a9f tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9035189a-56a0-4b07-9a27-3134343ca4f5 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:30 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9035189a-56a0-4b07-9a27-3134343ca4f5 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6 Jul 08 01:15:30 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:31 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-08f0def3-17b2-4d04-ae37-dcc16b4b8a9f tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9035189a-56a0-4b07-9a27-3134343ca4f5 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6" returned: 0 in 0.795s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:31 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-08f0def3-17b2-4d04-ae37-dcc16b4b8a9f tempest-VolumesSnapshotTestJSON-6837556 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6 is being set with open permissions: ugo+rw Jul 08 01:15:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-08f0def3-17b2-4d04-ae37-dcc16b4b8a9f tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:31 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6 Jul 08 01:15:31 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:32 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-08f0def3-17b2-4d04-ae37-dcc16b4b8a9f tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6" returned: 0 in 0.792s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-08f0def3-17b2-4d04-ae37-dcc16b4b8a9f tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:32 devstack sudo[100294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.info Jul 08 01:15:32 devstack sudo[100294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:33 devstack sudo[100294]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-08f0def3-17b2-4d04-ae37-dcc16b4b8a9f tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.info" returned: 0 in 0.778s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:33 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-08f0def3-17b2-4d04-ae37-dcc16b4b8a9f tempest-VolumesSnapshotTestJSON-6837556 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.info is being set with open permissions: ugo+rw Jul 08 01:15:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-08f0def3-17b2-4d04-ae37-dcc16b4b8a9f tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:33 devstack sudo[100297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.info Jul 08 01:15:33 devstack sudo[100297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:33 devstack sudo[100297]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-08f0def3-17b2-4d04-ae37-dcc16b4b8a9f tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.info" returned: 0 in 0.674s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-08f0def3-17b2-4d04-ae37-dcc16b4b8a9f tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.160s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:33 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-08f0def3-17b2-4d04-ae37-dcc16b4b8a9f tempest-VolumesSnapshotTestJSON-6837556 None] Create snapshot completed successfully Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Flow 'volume_create_manager' (a5e63a6f-b329-42cb-b9b2-2ca70de6ba82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739131c2-98bb-45f4-9cc5-06951eeaa755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (739131c2-98bb-45f4-9cc5-06951eeaa755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1175657491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=933cd32f-8f66-4216-bb26-b65192b12f6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bab65cd41a46a4bddb667016a620da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=c8367cf0-72d1-4c8f-bda9-897d41e55fb6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:35Z,use_quota=True,user_id='8b285ba96fbc49cd881fde73777b77f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3ea2fc-2099-4efd-ba12-7e2efaf71163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf3ea2fc-2099-4efd-ba12-7e2efaf71163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab402520-57ce-45ff-8301-c7ea2193010b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab402520-57ce-45ff-8301-c7ea2193010b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '933cd32f-8f66-4216-bb26-b65192b12f6c', 'volume_name': 'volume-933cd32f-8f66-4216-bb26-b65192b12f6c', 'volume_size': 2, 'snapshot_id': 'c8367cf0-72d1-4c8f-bda9-897d41e55fb6'}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2185af-a6fb-420c-963f-7e880e6699fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e2185af-a6fb-420c-963f-7e880e6699fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce1f259-1e96-4b08-aabc-195cc89c3459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:35 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Volume 933cd32f-8f66-4216-bb26-b65192b12f6c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-933cd32f-8f66-4216-bb26-b65192b12f6c', 'volume_size': 2, 'snapshot_id': 'c8367cf0-72d1-4c8f-bda9-897d41e55fb6'} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-quobyte-c8367cf0-72d1-4c8f-bda9-897d41e55fb6-933cd32f-8f66-4216-bb26-b65192b12f6c" by "_create_volume_from_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-c8367cf0-72d1-4c8f-bda9-897d41e55fb6-933cd32f-8f66-4216-bb26-b65192b12f6c" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Creating volume 933cd32f-8f66-4216-bb26-b65192b12f6c from snapshot c8367cf0-72d1-4c8f-bda9-897d41e55fb6 {{(pid=87123) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-quobyte-933cd32f-8f66-4216-bb26-b65192b12f6c" by "_copy_volume_from_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-933cd32f-8f66-4216-bb26-b65192b12f6c" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] snapshot: c8367cf0-72d1-4c8f-bda9-897d41e55fb6, volume: 933cd32f-8f66-4216-bb26-b65192b12f6c, {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d18d8673-ff78-453b-aacc-a7c049731312]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:35 devstack sudo[100301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6 Jul 08 01:15:35 devstack sudo[100301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:36 devstack sudo[100301]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6" returned: 0 in 0.873s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9035189a-56a0-4b07-9a27-3134343ca4f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:15:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5 {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:15:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Creating direct copy from snapshot {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:15:36 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc8c666-a999-47a3-aac3-54f48d8dbab5]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:36 devstack sudo[100306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5 Jul 08 01:15:36 devstack sudo[100306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:37 devstack sudo[100306]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5" returned: 0 in 0.844s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:37 devstack cinder-volume[87123]: DEBUG cinder.utils [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Path /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-933cd32f-8f66-4216-bb26-b65192b12f6c not found in is_blk_device check {{(pid=87123) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:15:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-933cd32f-8f66-4216-bb26-b65192b12f6c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:37 devstack sudo[100315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-933cd32f-8f66-4216-bb26-b65192b12f6c Jul 08 01:15:37 devstack sudo[100315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-3b1c6aca-2906-43ed-b0c6-837c8ab0a85a req-8ace187c-e8af-4955-bda2-430ae55a776d tempest-TestInstancesWithCinderVolumes-1157661349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:42 devstack sudo[100315]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-933cd32f-8f66-4216-bb26-b65192b12f6c" returned: 0 in 4.792s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:42 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c949a5-18b8-4bcd-ac3b-1e8315686e51]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:42 devstack sudo[100341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5 Jul 08 01:15:42 devstack sudo[100341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:43 devstack sudo[100341]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5" returned: 0 in 0.950s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:43 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Image conversion details: src /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5, size 1024.00 MB, duration 4.79 sec, destination /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-933cd32f-8f66-4216-bb26-b65192b12f6c {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:15:43 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Converted 1024.00 MB image at 213.66 MB/s Jul 08 01:15:43 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-933cd32f-8f66-4216-bb26-b65192b12f6c is being set with open permissions: ugo+rw Jul 08 01:15:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-933cd32f-8f66-4216-bb26-b65192b12f6c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:43 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-933cd32f-8f66-4216-bb26-b65192b12f6c Jul 08 01:15:43 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:43 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-933cd32f-8f66-4216-bb26-b65192b12f6c" returned: 0 in 0.687s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-933cd32f-8f66-4216-bb26-b65192b12f6c" released by "_copy_volume_from_snapshot" :: held 8.236s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-c8367cf0-72d1-4c8f-bda9-897d41e55fb6-933cd32f-8f66-4216-bb26-b65192b12f6c" released by "_create_volume_from_snapshot" :: held 8.263s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.278s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-3b1c6aca-2906-43ed-b0c6-837c8ab0a85a req-8ace187c-e8af-4955-bda2-430ae55a776d tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.572s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:43 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0cfdaa-7ac7-4a2b-9fd4-be0a5f4a30ed]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-3b1c6aca-2906-43ed-b0c6-837c8ab0a85a req-8ace187c-e8af-4955-bda2-430ae55a776d tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce1f259-1e96-4b08-aabc-195cc89c3459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-933cd32f-8f66-4216-bb26-b65192b12f6c', 'volume_size': 2, 'snapshot_id': 'c8367cf0-72d1-4c8f-bda9-897d41e55fb6'}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0869dd-1fe6-4321-af37-f5030260e75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:43 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Volume volume-933cd32f-8f66-4216-bb26-b65192b12f6c (933cd32f-8f66-4216-bb26-b65192b12f6c): created successfully Jul 08 01:15:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f0869dd-1fe6-4321-af37-f5030260e75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Flow 'volume_create_manager' (a5e63a6f-b329-42cb-b9b2-2ca70de6ba82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:43 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-7d7ed9f9-b5a4-47d4-866e-9fd95c36aeaf tempest-VolumesSnapshotTestJSON-6837556 None] Created volume successfully. Jul 08 01:15:44 devstack sudo[100351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d Jul 08 01:15:44 devstack sudo[100351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:44 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4cda7da7-5aed-409a-abb8-527714f9e212 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-933cd32f-8f66-4216-bb26-b65192b12f6c-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:44 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4cda7da7-5aed-409a-abb8-527714f9e212 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-933cd32f-8f66-4216-bb26-b65192b12f6c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:44 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4cda7da7-5aed-409a-abb8-527714f9e212 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-quobyte-933cd32f-8f66-4216-bb26-b65192b12f6c" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:44 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4cda7da7-5aed-409a-abb8-527714f9e212 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-933cd32f-8f66-4216-bb26-b65192b12f6c" acquired by "delete_volume" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:44 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b5e1747-5cd4-4fe0-b122-3c68f08f3713]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4cda7da7-5aed-409a-abb8-527714f9e212 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-933cd32f-8f66-4216-bb26-b65192b12f6c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:44 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-933cd32f-8f66-4216-bb26-b65192b12f6c Jul 08 01:15:44 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:44 devstack sudo[100351]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-3b1c6aca-2906-43ed-b0c6-837c8ab0a85a req-8ace187c-e8af-4955-bda2-430ae55a776d tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d" returned: 0 in 0.857s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-3b1c6aca-2906-43ed-b0c6-837c8ab0a85a req-8ace187c-e8af-4955-bda2-430ae55a776d tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.877s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:44 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-3b1c6aca-2906-43ed-b0c6-837c8ab0a85a req-8ace187c-e8af-4955-bda2-430ae55a776d tempest-TestInstancesWithCinderVolumes-1157661349 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e', 'name': 'volume-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ba6b9edb-4a02-446e-88fe-79ab78875d56', 'enforce_multipath': True} {{(pid=87123) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:15:44 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-3b1c6aca-2906-43ed-b0c6-837c8ab0a85a req-8ace187c-e8af-4955-bda2-430ae55a776d tempest-TestInstancesWithCinderVolumes-1157661349 None] attachment_update completed successfully. Jul 08 01:15:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:15:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:44 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:15:44 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:45 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4cda7da7-5aed-409a-abb8-527714f9e212 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-933cd32f-8f66-4216-bb26-b65192b12f6c" returned: 0 in 0.777s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4cda7da7-5aed-409a-abb8-527714f9e212 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-933cd32f-8f66-4216-bb26-b65192b12f6c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:45 devstack sudo[100363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-933cd32f-8f66-4216-bb26-b65192b12f6c Jul 08 01:15:45 devstack sudo[100363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:45 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.723s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:45 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:15:45 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:15:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 28 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:15:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:15:45 devstack sudo[100363]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4cda7da7-5aed-409a-abb8-527714f9e212 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-933cd32f-8f66-4216-bb26-b65192b12f6c" returned: 0 in 0.716s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4cda7da7-5aed-409a-abb8-527714f9e212 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-933cd32f-8f66-4216-bb26-b65192b12f6c" released by "delete_volume" :: held 1.549s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:46 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-4cda7da7-5aed-409a-abb8-527714f9e212 tempest-VolumesSnapshotTestJSON-6837556 None] Created reservations ['5edefc83-1f71-4785-a592-ae00661bd7ed', '7c12771b-e465-4534-8ab4-963e9554c7a2', '8020fd04-879c-48dd-986c-2871d343fba1', '08db805d-1a76-4a1f-a695-399d6998bc5b'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:15:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4cda7da7-5aed-409a-abb8-527714f9e212 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4cda7da7-5aed-409a-abb8-527714f9e212 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4cda7da7-5aed-409a-abb8-527714f9e212 tempest-VolumesSnapshotTestJSON-6837556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4cda7da7-5aed-409a-abb8-527714f9e212 tempest-VolumesSnapshotTestJSON-6837556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4cda7da7-5aed-409a-abb8-527714f9e212 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4cda7da7-5aed-409a-abb8-527714f9e212 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:46 devstack sudo[100369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:15:46 devstack sudo[100369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a8e8c6b4-db3d-43bd-bd4d-40c560d32863 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-c8367cf0-72d1-4c8f-bda9-897d41e55fb6-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a8e8c6b4-db3d-43bd-bd4d-40c560d32863 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-c8367cf0-72d1-4c8f-bda9-897d41e55fb6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a8e8c6b4-db3d-43bd-bd4d-40c560d32863 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-quobyte-9035189a-56a0-4b07-9a27-3134343ca4f5" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a8e8c6b4-db3d-43bd-bd4d-40c560d32863 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-9035189a-56a0-4b07-9a27-3134343ca4f5" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a8e8c6b4-db3d-43bd-bd4d-40c560d32863 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-quobyte-c8367cf0-72d1-4c8f-bda9-897d41e55fb6" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a8e8c6b4-db3d-43bd-bd4d-40c560d32863 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-c8367cf0-72d1-4c8f-bda9-897d41e55fb6" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-a8e8c6b4-db3d-43bd-bd4d-40c560d32863 tempest-VolumesSnapshotTestJSON-6837556 None] Deleting offline snapshot c8367cf0-72d1-4c8f-bda9-897d41e55fb6 of volume 9035189a-56a0-4b07-9a27-3134343ca4f5 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:15:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-a8e8c6b4-db3d-43bd-bd4d-40c560d32863 tempest-VolumesSnapshotTestJSON-6837556 None] snapshot_file for this snap is: volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:15:46 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c4de985-39e4-4e7e-baea-071c73e71a0d]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a8e8c6b4-db3d-43bd-bd4d-40c560d32863 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:46 devstack sudo[100369]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4cda7da7-5aed-409a-abb8-527714f9e212 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.705s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:46 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-4cda7da7-5aed-409a-abb8-527714f9e212 tempest-VolumesSnapshotTestJSON-6837556 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:15:46 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-4cda7da7-5aed-409a-abb8-527714f9e212 tempest-VolumesSnapshotTestJSON-6837556 None] Deleted volume successfully. Jul 08 01:15:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4cda7da7-5aed-409a-abb8-527714f9e212 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-933cd32f-8f66-4216-bb26-b65192b12f6c-delete_volume" released by "delete_volume" :: held 2.493s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:46 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6 Jul 08 01:15:46 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:47 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a8e8c6b4-db3d-43bd-bd4d-40c560d32863 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6" returned: 0 in 0.804s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-a8e8c6b4-db3d-43bd-bd4d-40c560d32863 tempest-VolumesSnapshotTestJSON-6837556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9035189a-56a0-4b07-9a27-3134343ca4f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:15:47 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4daab7a-cf53-4a9c-9fda-e4c94ed8a4e4]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a8e8c6b4-db3d-43bd-bd4d-40c560d32863 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:47 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5 Jul 08 01:15:47 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:48 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a8e8c6b4-db3d-43bd-bd4d-40c560d32863 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5" returned: 0 in 0.763s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a8e8c6b4-db3d-43bd-bd4d-40c560d32863 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:48 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6 Jul 08 01:15:48 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:49 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a8e8c6b4-db3d-43bd-bd4d-40c560d32863 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6" returned: 0 in 0.828s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a8e8c6b4-db3d-43bd-bd4d-40c560d32863 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:49 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6 Jul 08 01:15:49 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:49 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a8e8c6b4-db3d-43bd-bd4d-40c560d32863 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5.c8367cf0-72d1-4c8f-bda9-897d41e55fb6" returned: 0 in 0.671s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:49 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a8e8c6b4-db3d-43bd-bd4d-40c560d32863 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-c8367cf0-72d1-4c8f-bda9-897d41e55fb6" released by "_delete_snapshot" :: held 3.182s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:49 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a8e8c6b4-db3d-43bd-bd4d-40c560d32863 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-9035189a-56a0-4b07-9a27-3134343ca4f5" released by "delete_snapshot" :: held 3.211s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:50 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-a8e8c6b4-db3d-43bd-bd4d-40c560d32863 tempest-VolumesSnapshotTestJSON-6837556 None] Created reservations ['641acf0d-00ba-4333-b47b-aa4fa71f0b41', '38aada2a-be89-4242-b79d-aa1ec6b8e490', '3d119bb6-0bef-4c3e-93f2-9e41c01f002a', '82f74308-8fd4-4774-a36b-f8699ad157ae'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:15:50 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-a8e8c6b4-db3d-43bd-bd4d-40c560d32863 tempest-VolumesSnapshotTestJSON-6837556 None] Delete snapshot completed successfully. Jul 08 01:15:50 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a8e8c6b4-db3d-43bd-bd4d-40c560d32863 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-c8367cf0-72d1-4c8f-bda9-897d41e55fb6-delete_snapshot" released by "delete_snapshot" :: held 3.361s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:51 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3e6807e6-2f17-45b0-97a5-05ece9208c9b tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-9035189a-56a0-4b07-9a27-3134343ca4f5-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:51 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3e6807e6-2f17-45b0-97a5-05ece9208c9b tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-9035189a-56a0-4b07-9a27-3134343ca4f5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:51 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3e6807e6-2f17-45b0-97a5-05ece9208c9b tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-quobyte-9035189a-56a0-4b07-9a27-3134343ca4f5" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:15:51 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3e6807e6-2f17-45b0-97a5-05ece9208c9b tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-9035189a-56a0-4b07-9a27-3134343ca4f5" acquired by "delete_volume" :: waited 0.013s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:15:51 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a82c925-5543-4b32-a0e8-9de8961ef08c]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3e6807e6-2f17-45b0-97a5-05ece9208c9b tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:51 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5 Jul 08 01:15:51 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:51 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3e6807e6-2f17-45b0-97a5-05ece9208c9b tempest-VolumesSnapshotTestJSON-6837556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5" returned: 0 in 0.798s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3e6807e6-2f17-45b0-97a5-05ece9208c9b tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:51 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5 Jul 08 01:15:51 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:52 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3e6807e6-2f17-45b0-97a5-05ece9208c9b tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9035189a-56a0-4b07-9a27-3134343ca4f5" returned: 0 in 0.717s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3e6807e6-2f17-45b0-97a5-05ece9208c9b tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-9035189a-56a0-4b07-9a27-3134343ca4f5" released by "delete_volume" :: held 1.585s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-12a81725-cecf-4e00-aabc-43362a168572 req-2994ede0-090a-4f4e-8af4-3830ec9efb1c tempest-TestInstancesWithCinderVolumes-1157661349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-12a81725-cecf-4e00-aabc-43362a168572 req-2994ede0-090a-4f4e-8af4-3830ec9efb1c tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:52 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d378ee7c-4bb4-49be-9847-5054a5b22a1d]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-12a81725-cecf-4e00-aabc-43362a168572 req-2994ede0-090a-4f4e-8af4-3830ec9efb1c tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e11ff5-3705-45fb-9d04-20d87aaf1892 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:52 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-3e6807e6-2f17-45b0-97a5-05ece9208c9b tempest-VolumesSnapshotTestJSON-6837556 None] Created reservations ['a56e0f6d-8802-44b8-a5e0-4599cb998477', '37bcf8bd-2c88-4f95-9a82-2f41c63f9261', '5143127a-4c5b-4b28-9c4a-c9900ea2cd55', 'c567d96a-5402-4e50-b0a8-a2badda6a607'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:15:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3e6807e6-2f17-45b0-97a5-05ece9208c9b tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3e6807e6-2f17-45b0-97a5-05ece9208c9b tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3e6807e6-2f17-45b0-97a5-05ece9208c9b tempest-VolumesSnapshotTestJSON-6837556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3e6807e6-2f17-45b0-97a5-05ece9208c9b tempest-VolumesSnapshotTestJSON-6837556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3e6807e6-2f17-45b0-97a5-05ece9208c9b tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3e6807e6-2f17-45b0-97a5-05ece9208c9b tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:52 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e11ff5-3705-45fb-9d04-20d87aaf1892 Jul 08 01:15:52 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:52 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:15:52 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:53 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3e6807e6-2f17-45b0-97a5-05ece9208c9b tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.751s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:53 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-3e6807e6-2f17-45b0-97a5-05ece9208c9b tempest-VolumesSnapshotTestJSON-6837556 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:15:53 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-12a81725-cecf-4e00-aabc-43362a168572 req-2994ede0-090a-4f4e-8af4-3830ec9efb1c tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e11ff5-3705-45fb-9d04-20d87aaf1892" returned: 0 in 0.882s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-12a81725-cecf-4e00-aabc-43362a168572 req-2994ede0-090a-4f4e-8af4-3830ec9efb1c tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.908s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:53 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-3e6807e6-2f17-45b0-97a5-05ece9208c9b tempest-VolumesSnapshotTestJSON-6837556 None] Deleted volume successfully. Jul 08 01:15:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3e6807e6-2f17-45b0-97a5-05ece9208c9b tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-9035189a-56a0-4b07-9a27-3134343ca4f5-delete_volume" released by "delete_volume" :: held 2.606s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:15:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-12a81725-cecf-4e00-aabc-43362a168572 req-2994ede0-090a-4f4e-8af4-3830ec9efb1c tempest-TestInstancesWithCinderVolumes-1157661349 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e', 'name': 'volume-a2e11ff5-3705-45fb-9d04-20d87aaf1892', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '580b59f0-cc3a-4cb7-bf98-e5dbd3c8b081', 'enforce_multipath': True} {{(pid=87123) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:15:53 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-12a81725-cecf-4e00-aabc-43362a168572 req-2994ede0-090a-4f4e-8af4-3830ec9efb1c tempest-TestInstancesWithCinderVolumes-1157661349 None] attachment_update completed successfully. Jul 08 01:15:53 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:15:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Flow 'volume_create_manager' (c0f684bf-dd59-4f4d-bac5-0809723c97ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c098157-868d-4903-94cf-7fe2f76323bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c098157-868d-4903-94cf-7fe2f76323bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-313807069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a427d6-b632-4e28-8902-72419f8727b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bab65cd41a46a4bddb667016a620da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:54Z,use_quota=True,user_id='8b285ba96fbc49cd881fde73777b77f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ca0432-4413-4900-bb98-7332bd1f0af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65ca0432-4413-4900-bb98-7332bd1f0af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41223976-7918-4b34-b196-331dcf3dcd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41223976-7918-4b34-b196-331dcf3dcd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46a427d6-b632-4e28-8902-72419f8727b9', 'volume_name': 'volume-46a427d6-b632-4e28-8902-72419f8727b9', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878af577-7ff7-4341-be5b-aa6a1629ec23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (878af577-7ff7-4341-be5b-aa6a1629ec23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:54 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c9d617-6fd5-497e-8f0c-e22153009a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:54 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Volume 46a427d6-b632-4e28-8902-72419f8727b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46a427d6-b632-4e28-8902-72419f8727b9', 'volume_size': 1} Jul 08 01:15:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:15:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-313807069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46a427d6-b632-4e28-8902-72419f8727b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bab65cd41a46a4bddb667016a620da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:15:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:15:54Z,use_quota=True,user_id='8b285ba96fbc49cd881fde73777b77f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:15:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Creating volume 46a427d6-b632-4e28-8902-72419f8727b9 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:15:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:15:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:15:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:15:54 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:15:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:54 devstack sudo[100425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9 1073741824 Jul 08 01:15:54 devstack sudo[100425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:54 devstack sudo[100425]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9 1073741824" returned: 0 in 0.904s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:55 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9 Jul 08 01:15:55 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:55 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9" returned: 0 in 0.766s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:15:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:15:55 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5c9d617-6fd5-497e-8f0c-e22153009a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46a427d6-b632-4e28-8902-72419f8727b9', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:55 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39c10bd2-e640-4c35-a12d-bc429dec7317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:15:55 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Volume volume-46a427d6-b632-4e28-8902-72419f8727b9 (46a427d6-b632-4e28-8902-72419f8727b9): created successfully Jul 08 01:15:55 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39c10bd2-e640-4c35-a12d-bc429dec7317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:15:55 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Flow 'volume_create_manager' (c0f684bf-dd59-4f4d-bac5-0809723c97ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:15:55 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-36d00fa8-9de8-4ecc-b4ac-a608f7a9afe4 tempest-VolumesSnapshotTestJSON-6837556 None] Created volume successfully. Jul 08 01:15:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c71853d8-b144-4e8b-ad89-db2788979f2f tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:15:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c71853d8-b144-4e8b-ad89-db2788979f2f tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:15:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-c71853d8-b144-4e8b-ad89-db2788979f2f tempest-VolumesSnapshotTestJSON-6837556 None] Creating offline snapshot f21405d2-966a-4395-8f1a-49e772f48e6b of volume 46a427d6-b632-4e28-8902-72419f8727b9 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:15:56 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbf10f1-bb0b-449e-bdc6-a44b54dc363f]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:15:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c71853d8-b144-4e8b-ad89-db2788979f2f tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:56 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9 Jul 08 01:15:56 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:57 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c71853d8-b144-4e8b-ad89-db2788979f2f tempest-VolumesSnapshotTestJSON-6837556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9" returned: 0 in 0.826s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c71853d8-b144-4e8b-ad89-db2788979f2f tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:57 devstack sudo[100441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b 1G Jul 08 01:15:57 devstack sudo[100441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:57 devstack sudo[100441]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c71853d8-b144-4e8b-ad89-db2788979f2f tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b 1G" returned: 0 in 0.874s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c71853d8-b144-4e8b-ad89-db2788979f2f tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46a427d6-b632-4e28-8902-72419f8727b9 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:57 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46a427d6-b632-4e28-8902-72419f8727b9 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b Jul 08 01:15:57 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:58 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c71853d8-b144-4e8b-ad89-db2788979f2f tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46a427d6-b632-4e28-8902-72419f8727b9 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b" returned: 0 in 0.802s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:58 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-c71853d8-b144-4e8b-ad89-db2788979f2f tempest-VolumesSnapshotTestJSON-6837556 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b is being set with open permissions: ugo+rw Jul 08 01:15:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c71853d8-b144-4e8b-ad89-db2788979f2f tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:58 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b Jul 08 01:15:58 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:15:59 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Jul 08 01:15:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c71853d8-b144-4e8b-ad89-db2788979f2f tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b" returned: 0 in 0.712s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:15:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c71853d8-b144-4e8b-ad89-db2788979f2f tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:15:59 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.info Jul 08 01:15:59 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:00 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c71853d8-b144-4e8b-ad89-db2788979f2f tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.info" returned: 0 in 0.718s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:00 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-c71853d8-b144-4e8b-ad89-db2788979f2f tempest-VolumesSnapshotTestJSON-6837556 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.info is being set with open permissions: ugo+rw Jul 08 01:16:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c71853d8-b144-4e8b-ad89-db2788979f2f tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:00 devstack sudo[100466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.info Jul 08 01:16:00 devstack sudo[100466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:00 devstack sudo[100466]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c71853d8-b144-4e8b-ad89-db2788979f2f tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.info" returned: 0 in 0.729s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c71853d8-b144-4e8b-ad89-db2788979f2f tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.752s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:00 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-c71853d8-b144-4e8b-ad89-db2788979f2f tempest-VolumesSnapshotTestJSON-6837556 None] Create snapshot completed successfully Jul 08 01:16:01 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Flow 'volume_create_manager' (bee17bea-7d86-4114-bc15-fed9c1b378cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1031166d-0dc6-4c58-8f82-90ba26d5cd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1031166d-0dc6-4c58-8f82-90ba26d5cd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:16:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1670881812',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74df3aa6-d59f-4aea-bf4f-c8e0fff086e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bab65cd41a46a4bddb667016a620da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:16:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f21405d2-966a-4395-8f1a-49e772f48e6b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:16:02Z,use_quota=True,user_id='8b285ba96fbc49cd881fde73777b77f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0291c9ed-7c7a-4fa4-841b-af05f956da65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0291c9ed-7c7a-4fa4-841b-af05f956da65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7466e64b-2a1f-4692-80d6-6cf2519fe74a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7466e64b-2a1f-4692-80d6-6cf2519fe74a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '74df3aa6-d59f-4aea-bf4f-c8e0fff086e1', 'volume_name': 'volume-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1', 'volume_size': 1, 'snapshot_id': 'f21405d2-966a-4395-8f1a-49e772f48e6b'}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32255d19-ce2c-4fa7-ab71-b9b98bddeafa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32255d19-ce2c-4fa7-ab71-b9b98bddeafa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28234a50-b99f-4041-9836-c2d30b9c5edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:02 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Volume 74df3aa6-d59f-4aea-bf4f-c8e0fff086e1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1', 'volume_size': 1, 'snapshot_id': 'f21405d2-966a-4395-8f1a-49e772f48e6b'} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-quobyte-f21405d2-966a-4395-8f1a-49e772f48e6b-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1" by "_create_volume_from_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-f21405d2-966a-4395-8f1a-49e772f48e6b-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Creating volume 74df3aa6-d59f-4aea-bf4f-c8e0fff086e1 from snapshot f21405d2-966a-4395-8f1a-49e772f48e6b {{(pid=87123) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-quobyte-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1" by "_copy_volume_from_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] snapshot: f21405d2-966a-4395-8f1a-49e772f48e6b, volume: 74df3aa6-d59f-4aea-bf4f-c8e0fff086e1, {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c71185f-b804-4616-9242-42efab8ee190]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:02 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b Jul 08 01:16:02 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:03 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b" returned: 0 in 0.879s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:03 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46a427d6-b632-4e28-8902-72419f8727b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:16:03 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9 {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:16:03 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Creating direct copy from snapshot {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:16:03 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b371b45-fad2-4d19-87e5-6f48a69fea18]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:03 devstack sudo[100498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9 Jul 08 01:16:03 devstack sudo[100498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:03 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-8783463e-ba83-4ed5-ab39-cfa31319f66c req-02333a2b-881b-4435-9f05-104ebfa80cad tempest-TestInstancesWithCinderVolumes-1157661349 None] Terminate volume connection completed successfully. Jul 08 01:16:03 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-8783463e-ba83-4ed5-ab39-cfa31319f66c req-02333a2b-881b-4435-9f05-104ebfa80cad tempest-TestInstancesWithCinderVolumes-1157661349 None] Deleting attachment ba6b9edb-4a02-446e-88fe-79ab78875d56. {{(pid=87123) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:16:03 devstack sudo[100498]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9" returned: 0 in 0.810s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:03 devstack cinder-volume[87123]: DEBUG cinder.utils [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Path /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1 not found in is_blk_device check {{(pid=87123) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:16:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:03 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1 Jul 08 01:16:03 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:05 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9f71e543-a379-40ef-89c7-664a92ed62a2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Acquiring lock "cinder-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:06 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9f71e543-a379-40ef-89c7-664a92ed62a2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "cinder-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:06 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9f71e543-a379-40ef-89c7-664a92ed62a2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Acquiring lock "cinder-quobyte-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:06 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9f71e543-a379-40ef-89c7-664a92ed62a2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "cinder-quobyte-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d" acquired by "delete_volume" :: waited 0.045s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:06 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f389490-4446-4d56-abc8-bea9262ab122]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9f71e543-a379-40ef-89c7-664a92ed62a2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:06 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d Jul 08 01:16:06 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:08 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9f71e543-a379-40ef-89c7-664a92ed62a2 tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d" returned: 0 in 1.922s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9f71e543-a379-40ef-89c7-664a92ed62a2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:08 devstack sudo[100527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d Jul 08 01:16:08 devstack sudo[100527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:09 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1" returned: 0 in 5.450s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:09 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49970df-ebc1-42a8-8724-28dd6534bde8]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:09 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9 Jul 08 01:16:09 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:09 devstack sudo[100527]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9f71e543-a379-40ef-89c7-664a92ed62a2 tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d" returned: 0 in 1.419s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9f71e543-a379-40ef-89c7-664a92ed62a2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "cinder-quobyte-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d" released by "delete_volume" :: held 3.456s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:09 devstack cinder-volume[87123]: WARNING cinder.quota [None req-9f71e543-a379-40ef-89c7-664a92ed62a2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-460233655-1038174817 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-460233655-1038174817, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:16:09 devstack cinder-volume[87123]: WARNING cinder.quota [None req-9f71e543-a379-40ef-89c7-664a92ed62a2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-460233655-1038174817 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-460233655-1038174817, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:16:09 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-9f71e543-a379-40ef-89c7-664a92ed62a2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Created reservations ['a940c589-f0e7-4d0e-be3b-dde09666ef51', '21132957-49dd-4fce-ab3c-eda0e89232a6', 'b8cf384f-c088-468f-80db-1d693f194cf6', 'e6bfefe8-f06c-4eec-8f3a-dc1bfc4c3db4'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:16:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9f71e543-a379-40ef-89c7-664a92ed62a2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9f71e543-a379-40ef-89c7-664a92ed62a2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9f71e543-a379-40ef-89c7-664a92ed62a2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9f71e543-a379-40ef-89c7-664a92ed62a2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9f71e543-a379-40ef-89c7-664a92ed62a2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9f71e543-a379-40ef-89c7-664a92ed62a2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:09 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:16:09 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:10 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9" returned: 0 in 1.091s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:10 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Image conversion details: src /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9, size 1024.00 MB, duration 5.45 sec, destination /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1 {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:16:10 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Converted 1024.00 MB image at 187.85 MB/s Jul 08 01:16:10 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1 is being set with open permissions: ugo+rw Jul 08 01:16:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:10 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9f71e543-a379-40ef-89c7-664a92ed62a2 tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.757s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:10 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-9f71e543-a379-40ef-89c7-664a92ed62a2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:16:10 devstack sudo[100559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1 Jul 08 01:16:10 devstack sudo[100559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:10 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-9f71e543-a379-40ef-89c7-664a92ed62a2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Deleted volume successfully. Jul 08 01:16:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9f71e543-a379-40ef-89c7-664a92ed62a2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "cinder-680f6502-e2e8-47a9-b8f7-7d0f197bdd8d-delete_volume" released by "delete_volume" :: held 4.554s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:11 devstack sudo[100559]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1" returned: 0 in 0.774s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:11 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1" released by "_copy_volume_from_snapshot" :: held 9.119s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:11 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-f21405d2-966a-4395-8f1a-49e772f48e6b-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1" released by "_create_volume_from_snapshot" :: held 9.154s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.172s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28234a50-b99f-4041-9836-c2d30b9c5edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1', 'volume_size': 1, 'snapshot_id': 'f21405d2-966a-4395-8f1a-49e772f48e6b'}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7186f535-38df-4260-95e3-a2115ae13baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:16:11 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Volume volume-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1 (74df3aa6-d59f-4aea-bf4f-c8e0fff086e1): created successfully Jul 08 01:16:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7186f535-38df-4260-95e3-a2115ae13baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:16:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Flow 'volume_create_manager' (bee17bea-7d86-4114-bc15-fed9c1b378cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:16:11 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-deef5d9c-5c35-4c22-9d7c-ce7c6f2825a5 tempest-VolumesSnapshotTestJSON-6837556 None] Created volume successfully. Jul 08 01:16:12 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=58,cinder:UPDATE=61,cinder:INSERT=15,cinder:DELETE=3 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:16:12 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:UPDATE=51,cinder:SELECT=75,cinder:INSERT=11,cinder:DELETE=8 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:16:12 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-90939bda-2135-4d21-bf0d-1bd2721c7537 req-c803621f-4790-43ef-bb13-0c71a44e9c64 tempest-TestInstancesWithCinderVolumes-1157661349 None] Terminate volume connection completed successfully. Jul 08 01:16:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-90939bda-2135-4d21-bf0d-1bd2721c7537 req-c803621f-4790-43ef-bb13-0c71a44e9c64 tempest-TestInstancesWithCinderVolumes-1157661349 None] Deleting attachment 580b59f0-cc3a-4cb7-bf98-e5dbd3c8b081. {{(pid=87123) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:16:12 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b07effa2-c5ea-49e4-a660-f05200f2476d tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:12 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b07effa2-c5ea-49e4-a660-f05200f2476d tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:12 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b07effa2-c5ea-49e4-a660-f05200f2476d tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-quobyte-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:12 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b07effa2-c5ea-49e4-a660-f05200f2476d tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1" acquired by "delete_volume" :: waited 0.014s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:12 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a3e0a98-d015-4877-847d-72c9ffccbcb5]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b07effa2-c5ea-49e4-a660-f05200f2476d tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:12 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1 Jul 08 01:16:12 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:13 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b07effa2-c5ea-49e4-a660-f05200f2476d tempest-VolumesSnapshotTestJSON-6837556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1" returned: 0 in 0.794s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b07effa2-c5ea-49e4-a660-f05200f2476d tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:13 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1 Jul 08 01:16:13 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:13 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b07effa2-c5ea-49e4-a660-f05200f2476d tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1" returned: 0 in 0.723s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b07effa2-c5ea-49e4-a660-f05200f2476d tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1" released by "delete_volume" :: held 1.568s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-b07effa2-c5ea-49e4-a660-f05200f2476d tempest-VolumesSnapshotTestJSON-6837556 None] Created reservations ['5459359e-1074-45e2-8cca-2191bd76a743', 'e3f7aa5b-a66c-48eb-8126-8d210d053744', '09134389-3f33-4a95-bb4a-f7d14443b1dd', '420280d8-4a8f-42ca-ac62-c4a0df28d57b'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6a23dfba-580b-497b-94cf-3b55c15bafd2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Acquiring lock "cinder-a2e11ff5-3705-45fb-9d04-20d87aaf1892-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6a23dfba-580b-497b-94cf-3b55c15bafd2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "cinder-a2e11ff5-3705-45fb-9d04-20d87aaf1892-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b07effa2-c5ea-49e4-a660-f05200f2476d tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b07effa2-c5ea-49e4-a660-f05200f2476d tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b07effa2-c5ea-49e4-a660-f05200f2476d tempest-VolumesSnapshotTestJSON-6837556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b07effa2-c5ea-49e4-a660-f05200f2476d tempest-VolumesSnapshotTestJSON-6837556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b07effa2-c5ea-49e4-a660-f05200f2476d tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b07effa2-c5ea-49e4-a660-f05200f2476d tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6a23dfba-580b-497b-94cf-3b55c15bafd2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Acquiring lock "cinder-quobyte-a2e11ff5-3705-45fb-9d04-20d87aaf1892" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6a23dfba-580b-497b-94cf-3b55c15bafd2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "cinder-quobyte-a2e11ff5-3705-45fb-9d04-20d87aaf1892" acquired by "delete_volume" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:14 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:16:14 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac962f7-7132-412b-8b1d-c3f335202c89]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6a23dfba-580b-497b-94cf-3b55c15bafd2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e11ff5-3705-45fb-9d04-20d87aaf1892 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:14 devstack sudo[100575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e11ff5-3705-45fb-9d04-20d87aaf1892 Jul 08 01:16:14 devstack sudo[100575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-510c10fb-6aa4-4e25-9081-5a78578a9f73 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-f21405d2-966a-4395-8f1a-49e772f48e6b-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-510c10fb-6aa4-4e25-9081-5a78578a9f73 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-f21405d2-966a-4395-8f1a-49e772f48e6b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-510c10fb-6aa4-4e25-9081-5a78578a9f73 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-quobyte-46a427d6-b632-4e28-8902-72419f8727b9" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-510c10fb-6aa4-4e25-9081-5a78578a9f73 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-46a427d6-b632-4e28-8902-72419f8727b9" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-510c10fb-6aa4-4e25-9081-5a78578a9f73 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-quobyte-f21405d2-966a-4395-8f1a-49e772f48e6b" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-510c10fb-6aa4-4e25-9081-5a78578a9f73 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-f21405d2-966a-4395-8f1a-49e772f48e6b" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-510c10fb-6aa4-4e25-9081-5a78578a9f73 tempest-VolumesSnapshotTestJSON-6837556 None] Deleting offline snapshot f21405d2-966a-4395-8f1a-49e772f48e6b of volume 46a427d6-b632-4e28-8902-72419f8727b9 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-510c10fb-6aa4-4e25-9081-5a78578a9f73 tempest-VolumesSnapshotTestJSON-6837556 None] snapshot_file for this snap is: volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[20900df4-e4f6-4d92-b5cb-016a9e51338b]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-510c10fb-6aa4-4e25-9081-5a78578a9f73 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:14 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b07effa2-c5ea-49e4-a660-f05200f2476d tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.791s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-b07effa2-c5ea-49e4-a660-f05200f2476d tempest-VolumesSnapshotTestJSON-6837556 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:16:14 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b Jul 08 01:16:14 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:14 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b07effa2-c5ea-49e4-a660-f05200f2476d tempest-VolumesSnapshotTestJSON-6837556 None] Deleted volume successfully. Jul 08 01:16:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b07effa2-c5ea-49e4-a660-f05200f2476d tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-74df3aa6-d59f-4aea-bf4f-c8e0fff086e1-delete_volume" released by "delete_volume" :: held 2.625s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:15 devstack sudo[100575]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6a23dfba-580b-497b-94cf-3b55c15bafd2 tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e11ff5-3705-45fb-9d04-20d87aaf1892" returned: 0 in 1.019s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6a23dfba-580b-497b-94cf-3b55c15bafd2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e11ff5-3705-45fb-9d04-20d87aaf1892 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:15 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e11ff5-3705-45fb-9d04-20d87aaf1892 Jul 08 01:16:15 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:15 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-510c10fb-6aa4-4e25-9081-5a78578a9f73 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b" returned: 0 in 1.130s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-510c10fb-6aa4-4e25-9081-5a78578a9f73 tempest-VolumesSnapshotTestJSON-6837556 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46a427d6-b632-4e28-8902-72419f8727b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:16:15 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[548af57b-b3f1-42be-8a2f-5373256b0712]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-510c10fb-6aa4-4e25-9081-5a78578a9f73 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:16 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9 Jul 08 01:16:16 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:16 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6a23dfba-580b-497b-94cf-3b55c15bafd2 tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2e11ff5-3705-45fb-9d04-20d87aaf1892" returned: 0 in 0.925s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6a23dfba-580b-497b-94cf-3b55c15bafd2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "cinder-quobyte-a2e11ff5-3705-45fb-9d04-20d87aaf1892" released by "delete_volume" :: held 2.036s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:16 devstack cinder-volume[87123]: WARNING cinder.quota [None req-6a23dfba-580b-497b-94cf-3b55c15bafd2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-683718371-1195117466 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-683718371-1195117466, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:16:16 devstack cinder-volume[87123]: WARNING cinder.quota [None req-6a23dfba-580b-497b-94cf-3b55c15bafd2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-683718371-1195117466 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-683718371-1195117466, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:16:16 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-6a23dfba-580b-497b-94cf-3b55c15bafd2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Created reservations ['39b63cd3-bc2a-4f38-aef3-a54c8f774096', 'e424c586-9f42-463c-b5ad-46fb71181a8f', '1636d58f-c6f4-41b8-9046-af1ced8489f7', '2276377b-8274-4a29-ba22-5aaff9f02483'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:16:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6a23dfba-580b-497b-94cf-3b55c15bafd2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6a23dfba-580b-497b-94cf-3b55c15bafd2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6a23dfba-580b-497b-94cf-3b55c15bafd2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6a23dfba-580b-497b-94cf-3b55c15bafd2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6a23dfba-580b-497b-94cf-3b55c15bafd2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6a23dfba-580b-497b-94cf-3b55c15bafd2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:16 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:16:16 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:17 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-510c10fb-6aa4-4e25-9081-5a78578a9f73 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9" returned: 0 in 1.116s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-510c10fb-6aa4-4e25-9081-5a78578a9f73 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:17 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b Jul 08 01:16:17 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:17 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6a23dfba-580b-497b-94cf-3b55c15bafd2 tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.847s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:17 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-6a23dfba-580b-497b-94cf-3b55c15bafd2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:16:17 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-6a23dfba-580b-497b-94cf-3b55c15bafd2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Deleted volume successfully. Jul 08 01:16:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6a23dfba-580b-497b-94cf-3b55c15bafd2 tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "cinder-a2e11ff5-3705-45fb-9d04-20d87aaf1892-delete_volume" released by "delete_volume" :: held 3.182s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:17 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-510c10fb-6aa4-4e25-9081-5a78578a9f73 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b" returned: 0 in 0.786s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-510c10fb-6aa4-4e25-9081-5a78578a9f73 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:17 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b Jul 08 01:16:17 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:18 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-510c10fb-6aa4-4e25-9081-5a78578a9f73 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9.f21405d2-966a-4395-8f1a-49e772f48e6b" returned: 0 in 0.656s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:18 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-510c10fb-6aa4-4e25-9081-5a78578a9f73 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-f21405d2-966a-4395-8f1a-49e772f48e6b" released by "_delete_snapshot" :: held 3.860s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:18 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-510c10fb-6aa4-4e25-9081-5a78578a9f73 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-46a427d6-b632-4e28-8902-72419f8727b9" released by "delete_snapshot" :: held 3.883s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:18 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-510c10fb-6aa4-4e25-9081-5a78578a9f73 tempest-VolumesSnapshotTestJSON-6837556 None] Created reservations ['c69b6566-3509-4350-8302-755095090747', 'e85868e7-4225-4a97-a201-50d013a574a9', '31ecdcf9-f6ad-4aec-a678-38068701dc79', '18827c36-8c78-4c1b-9bbe-af8590a4cb62'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:16:18 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-510c10fb-6aa4-4e25-9081-5a78578a9f73 tempest-VolumesSnapshotTestJSON-6837556 None] Delete snapshot completed successfully. Jul 08 01:16:18 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-510c10fb-6aa4-4e25-9081-5a78578a9f73 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-f21405d2-966a-4395-8f1a-49e772f48e6b-delete_snapshot" released by "delete_snapshot" :: held 4.056s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:19 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-da517d1a-9c76-4946-a579-a11868f09ba4 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-46a427d6-b632-4e28-8902-72419f8727b9-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:19 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-da517d1a-9c76-4946-a579-a11868f09ba4 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-46a427d6-b632-4e28-8902-72419f8727b9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:19 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-da517d1a-9c76-4946-a579-a11868f09ba4 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-quobyte-46a427d6-b632-4e28-8902-72419f8727b9" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:19 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-da517d1a-9c76-4946-a579-a11868f09ba4 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-46a427d6-b632-4e28-8902-72419f8727b9" acquired by "delete_volume" :: waited 0.028s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:19 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f39d5e9-2b24-4b53-b568-2dc49d6e59cc]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-da517d1a-9c76-4946-a579-a11868f09ba4 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:19 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9 Jul 08 01:16:19 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:20 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-da517d1a-9c76-4946-a579-a11868f09ba4 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9" returned: 0 in 0.895s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-da517d1a-9c76-4946-a579-a11868f09ba4 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:20 devstack sudo[100677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9 Jul 08 01:16:20 devstack sudo[100677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:20 devstack sudo[100677]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-da517d1a-9c76-4946-a579-a11868f09ba4 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46a427d6-b632-4e28-8902-72419f8727b9" returned: 0 in 0.715s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-da517d1a-9c76-4946-a579-a11868f09ba4 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-46a427d6-b632-4e28-8902-72419f8727b9" released by "delete_volume" :: held 1.751s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:20 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-da517d1a-9c76-4946-a579-a11868f09ba4 tempest-VolumesSnapshotTestJSON-6837556 None] Created reservations ['bb4fdfc7-33b0-42d3-80f4-524b20deecd0', '8364970a-392b-4983-99d0-460f5ee05b9c', '0e0abb12-0baa-45da-a22e-5f06dc9334e6', '20ee1e3e-aae9-4f8d-9a58-3bbab593071e'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:16:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-da517d1a-9c76-4946-a579-a11868f09ba4 tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-da517d1a-9c76-4946-a579-a11868f09ba4 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-da517d1a-9c76-4946-a579-a11868f09ba4 tempest-VolumesSnapshotTestJSON-6837556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-da517d1a-9c76-4946-a579-a11868f09ba4 tempest-VolumesSnapshotTestJSON-6837556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-da517d1a-9c76-4946-a579-a11868f09ba4 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-da517d1a-9c76-4946-a579-a11868f09ba4 tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:21 devstack sudo[100682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:16:21 devstack sudo[100682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2c9d93a5-207b-4262-9911-1bbf9d45d0bb tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-9f7dccab-28d6-41d4-9bee-37fa834f5cf5-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2c9d93a5-207b-4262-9911-1bbf9d45d0bb tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-9f7dccab-28d6-41d4-9bee-37fa834f5cf5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:21 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-3648d06a-6c33-4fe2-b38d-922ce730ab6f req-fa6d4f9f-57c9-4265-ab5a-26e3e10452b8 tempest-TestInstancesWithCinderVolumes-1157661349 None] Terminate volume connection completed successfully. Jul 08 01:16:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-3648d06a-6c33-4fe2-b38d-922ce730ab6f req-fa6d4f9f-57c9-4265-ab5a-26e3e10452b8 tempest-TestInstancesWithCinderVolumes-1157661349 None] Deleting attachment 1215bf9e-aa25-44d8-97b8-e43159940a26. {{(pid=87123) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:16:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2c9d93a5-207b-4262-9911-1bbf9d45d0bb tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "cinder-quobyte-9f7dccab-28d6-41d4-9bee-37fa834f5cf5" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2c9d93a5-207b-4262-9911-1bbf9d45d0bb tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-9f7dccab-28d6-41d4-9bee-37fa834f5cf5" acquired by "delete_volume" :: waited 0.016s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:21 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[55447f65-de52-4b90-b77b-e8923437074f]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2c9d93a5-207b-4262-9911-1bbf9d45d0bb tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:21 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5 Jul 08 01:16:21 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:21 devstack sudo[100682]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-da517d1a-9c76-4946-a579-a11868f09ba4 tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.701s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:21 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-da517d1a-9c76-4946-a579-a11868f09ba4 tempest-VolumesSnapshotTestJSON-6837556 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:16:21 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-da517d1a-9c76-4946-a579-a11868f09ba4 tempest-VolumesSnapshotTestJSON-6837556 None] Deleted volume successfully. Jul 08 01:16:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-da517d1a-9c76-4946-a579-a11868f09ba4 tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-46a427d6-b632-4e28-8902-72419f8727b9-delete_volume" released by "delete_volume" :: held 2.674s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:22 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2c9d93a5-207b-4262-9911-1bbf9d45d0bb tempest-VolumesSnapshotTestJSON-6837556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5" returned: 0 in 0.890s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2c9d93a5-207b-4262-9911-1bbf9d45d0bb tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:22 devstack sudo[100696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5 Jul 08 01:16:22 devstack sudo[100696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:23 devstack sudo[100696]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2c9d93a5-207b-4262-9911-1bbf9d45d0bb tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9f7dccab-28d6-41d4-9bee-37fa834f5cf5" returned: 0 in 0.761s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2c9d93a5-207b-4262-9911-1bbf9d45d0bb tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-quobyte-9f7dccab-28d6-41d4-9bee-37fa834f5cf5" released by "delete_volume" :: held 1.714s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:23 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-2c9d93a5-207b-4262-9911-1bbf9d45d0bb tempest-VolumesSnapshotTestJSON-6837556 None] Created reservations ['631248b1-e358-42c6-8788-185fb0d64c70', '2d90bb20-9c71-4cc8-8aef-8a78679b51c3', '3c6965b2-570d-4e8b-86a4-b764fc2fa097', '4269bbe3-1687-435a-beb3-97b70012a244'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:16:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2c9d93a5-207b-4262-9911-1bbf9d45d0bb tempest-VolumesSnapshotTestJSON-6837556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2c9d93a5-207b-4262-9911-1bbf9d45d0bb tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2c9d93a5-207b-4262-9911-1bbf9d45d0bb tempest-VolumesSnapshotTestJSON-6837556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2c9d93a5-207b-4262-9911-1bbf9d45d0bb tempest-VolumesSnapshotTestJSON-6837556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2c9d93a5-207b-4262-9911-1bbf9d45d0bb tempest-VolumesSnapshotTestJSON-6837556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2c9d93a5-207b-4262-9911-1bbf9d45d0bb tempest-VolumesSnapshotTestJSON-6837556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:23 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:16:23 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:24 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2c9d93a5-207b-4262-9911-1bbf9d45d0bb tempest-VolumesSnapshotTestJSON-6837556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.720s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:24 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-2c9d93a5-207b-4262-9911-1bbf9d45d0bb tempest-VolumesSnapshotTestJSON-6837556 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:16:24 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-2c9d93a5-207b-4262-9911-1bbf9d45d0bb tempest-VolumesSnapshotTestJSON-6837556 None] Deleted volume successfully. Jul 08 01:16:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-2c9d93a5-207b-4262-9911-1bbf9d45d0bb tempest-VolumesSnapshotTestJSON-6837556 None] Lock "cinder-9f7dccab-28d6-41d4-9bee-37fa834f5cf5-delete_volume" released by "delete_volume" :: held 2.695s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] Acquiring lock "cinder-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "cinder-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] Acquiring lock "cinder-quobyte-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:16:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "cinder-quobyte-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8" acquired by "delete_volume" :: waited 0.016s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:16:25 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[628ef5c2-a133-4e56-905f-3b818afc1bc3]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:16:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:25 devstack sudo[100703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 Jul 08 01:16:25 devstack sudo[100703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:26 devstack sudo[100703]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8" returned: 0 in 0.868s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:26 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 Jul 08 01:16:26 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:27 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8" returned: 1 in 0.958s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:16:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:27 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8 Jul 08 01:16:27 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:27 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8" returned: 0 in 0.800s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:27 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "cinder-quobyte-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8" released by "delete_volume" :: held 2.704s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:28 devstack cinder-volume[87123]: WARNING cinder.quota [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1337235247-760241628 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1337235247-760241628, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:16:28 devstack cinder-volume[87123]: WARNING cinder.quota [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1337235247-760241628 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1337235247-760241628, it is now deprecated. Please use the default quota class for default quota. Jul 08 01:16:28 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] Created reservations ['0f9f8d9f-e89d-445f-ab91-f40e5de1f66b', '5cf3217f-074b-4fd5-b613-76cc4e724db6', 'c00ae9a4-26c9-4cc6-bab9-a2b7a1bece0d', '4b731031-ef84-49e0-9234-451da72eddce'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:16:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:28 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:28 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:28 devstack sudo[100716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:16:28 devstack sudo[100716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:28 devstack sudo[100716]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.740s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:28 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:16:28 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] Deleted volume successfully. Jul 08 01:16:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c83a0ae8-5058-4a93-abfe-7df834fbd002 tempest-TestInstancesWithCinderVolumes-1157661349 None] Lock "cinder-43b42c65-efd8-407d-b7d3-d4aeb1cdf3f8-delete_volume" released by "delete_volume" :: held 3.677s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:16:38 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=31,cinder:UPDATE=44,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:16:38 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=32,cinder:INSERT=13,cinder:UPDATE=47,cinder:DELETE=3 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:16:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:16:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:16:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:16:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:16:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:16:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:16:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:16:44 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:16:44 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:16:45 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Jul 08 01:16:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.790s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:16:45 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:16:45 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:16:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 28 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:16:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:17:06 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=1 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:17:06 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:UPDATE=1 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:17:19 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:17:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Flow 'volume_create_manager' (2d739b57-d48c-4f0b-99f0-507f128eb6d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:17:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (350da649-6dd2-4b91-a328-f6867238f602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (350da649-6dd2-4b91-a328-f6867238f602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-908979249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c3ac58-5e86-4e83-a1b1-57b772fcf787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023838aba9a2439da3c93623a2388dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:17:20Z,use_quota=True,user_id='af7bfdfa6f3f4ab68c08e6e90a600837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a7ede2-c4fd-45c9-af6e-b62e1f9d4c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a7ede2-c4fd-45c9-af6e-b62e1f9d4c6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634348fc-96da-442c-8bf1-96e4e1df510b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (634348fc-96da-442c-8bf1-96e4e1df510b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4c3ac58-5e86-4e83-a1b1-57b772fcf787', 'volume_name': 'volume-e4c3ac58-5e86-4e83-a1b1-57b772fcf787', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f21c97e-fd8f-47e3-8cf9-a94b727b479a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f21c97e-fd8f-47e3-8cf9-a94b727b479a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390eb67b-83d0-4410-856b-a4f0f95a7bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:19 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Volume e4c3ac58-5e86-4e83-a1b1-57b772fcf787: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4c3ac58-5e86-4e83-a1b1-57b772fcf787', 'volume_size': 1} Jul 08 01:17:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:17:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-908979249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4c3ac58-5e86-4e83-a1b1-57b772fcf787,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023838aba9a2439da3c93623a2388dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:17:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:17:20Z,use_quota=True,user_id='af7bfdfa6f3f4ab68c08e6e90a600837',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:17:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Creating volume e4c3ac58-5e86-4e83-a1b1-57b772fcf787 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:17:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:17:19 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:17:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e4c3ac58-5e86-4e83-a1b1-57b772fcf787 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:19 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e4c3ac58-5e86-4e83-a1b1-57b772fcf787 1073741824 Jul 08 01:17:19 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:20 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e4c3ac58-5e86-4e83-a1b1-57b772fcf787 1073741824" returned: 0 in 1.132s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e4c3ac58-5e86-4e83-a1b1-57b772fcf787 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:21 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e4c3ac58-5e86-4e83-a1b1-57b772fcf787 Jul 08 01:17:21 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:21 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e4c3ac58-5e86-4e83-a1b1-57b772fcf787" returned: 0 in 0.943s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] <== create_volume: return (2288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:17:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.292s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (390eb67b-83d0-4410-856b-a4f0f95a7bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4c3ac58-5e86-4e83-a1b1-57b772fcf787', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c871bf56-1e18-4215-bf96-43ce4dc96a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:22 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Volume volume-e4c3ac58-5e86-4e83-a1b1-57b772fcf787 (e4c3ac58-5e86-4e83-a1b1-57b772fcf787): created successfully Jul 08 01:17:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c871bf56-1e18-4215-bf96-43ce4dc96a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Flow 'volume_create_manager' (2d739b57-d48c-4f0b-99f0-507f128eb6d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:17:22 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-ab00eb6f-15e6-4bb2-a75f-db3d14c4f4de tempest-TestMinimumBasicScenario-64435126 None] Created volume successfully. Jul 08 01:17:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-5bceb50c-3412-4dc5-a0bd-48cb2c9e97dd req-b5331e53-4075-4795-b3bd-6c62f4343fbb tempest-TestMinimumBasicScenario-64435126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-5bceb50c-3412-4dc5-a0bd-48cb2c9e97dd req-b5331e53-4075-4795-b3bd-6c62f4343fbb tempest-TestMinimumBasicScenario-64435126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:30 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[c744ea01-0d3e-4864-ad14-a9a8e3015f47]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:17:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-5bceb50c-3412-4dc5-a0bd-48cb2c9e97dd req-b5331e53-4075-4795-b3bd-6c62f4343fbb tempest-TestMinimumBasicScenario-64435126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e4c3ac58-5e86-4e83-a1b1-57b772fcf787 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:30 devstack sudo[101055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e4c3ac58-5e86-4e83-a1b1-57b772fcf787 Jul 08 01:17:30 devstack sudo[101055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:31 devstack sudo[101055]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-5bceb50c-3412-4dc5-a0bd-48cb2c9e97dd req-b5331e53-4075-4795-b3bd-6c62f4343fbb tempest-TestMinimumBasicScenario-64435126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e4c3ac58-5e86-4e83-a1b1-57b772fcf787" returned: 0 in 0.835s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-5bceb50c-3412-4dc5-a0bd-48cb2c9e97dd req-b5331e53-4075-4795-b3bd-6c62f4343fbb tempest-TestMinimumBasicScenario-64435126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.858s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-5bceb50c-3412-4dc5-a0bd-48cb2c9e97dd req-b5331e53-4075-4795-b3bd-6c62f4343fbb tempest-TestMinimumBasicScenario-64435126 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e', 'name': 'volume-e4c3ac58-5e86-4e83-a1b1-57b772fcf787', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ae4d909f-b8f5-40dc-adc3-33ab14461e4f', 'enforce_multipath': True} {{(pid=87123) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:17:31 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-5bceb50c-3412-4dc5-a0bd-48cb2c9e97dd req-b5331e53-4075-4795-b3bd-6c62f4343fbb tempest-TestMinimumBasicScenario-64435126 None] attachment_update completed successfully. Jul 08 01:17:41 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:17:41 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:17:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:17:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:44 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:17:44 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:45 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.679s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:45 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:17:45 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:17:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 28 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:17:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:17:50 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:17:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Flow 'volume_create_manager' (f756be4b-0eb3-47ce-9172-22a8b59de942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:17:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f54e71-2c09-4d94-ae32-a68490d742f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4f54e71-2c09-4d94-ae32-a68490d742f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1437221858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=281715e7-b034-4507-9bf2-d8bba2e97880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d112a7516a114f98a5e5c4d530a021b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:17:51Z,use_quota=True,user_id='a7cce42fbde54697bad451447635e29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce811ce-39ed-4b9d-9b31-480fe56f9c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce811ce-39ed-4b9d-9b31-480fe56f9c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd93cb5d-922e-4e80-9582-a2ac1572b878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd93cb5d-922e-4e80-9582-a2ac1572b878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '281715e7-b034-4507-9bf2-d8bba2e97880', 'volume_name': 'volume-281715e7-b034-4507-9bf2-d8bba2e97880', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4952bd0-9180-4324-963a-49882b929d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4952bd0-9180-4324-963a-49882b929d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53993d31-b1ee-4097-b96f-9067a4e2fee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:51 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Volume 281715e7-b034-4507-9bf2-d8bba2e97880: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-281715e7-b034-4507-9bf2-d8bba2e97880', 'volume_size': 1} Jul 08 01:17:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1437221858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=281715e7-b034-4507-9bf2-d8bba2e97880,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d112a7516a114f98a5e5c4d530a021b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:17:51Z,use_quota=True,user_id='a7cce42fbde54697bad451447635e29a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:17:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Creating volume 281715e7-b034-4507-9bf2-d8bba2e97880 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:17:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:17:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:17:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:17:51 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:17:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-281715e7-b034-4507-9bf2-d8bba2e97880 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:51 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-281715e7-b034-4507-9bf2-d8bba2e97880 1073741824 Jul 08 01:17:51 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:51 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-281715e7-b034-4507-9bf2-d8bba2e97880 1073741824" returned: 0 in 0.881s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-281715e7-b034-4507-9bf2-d8bba2e97880 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:52 devstack sudo[101510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-281715e7-b034-4507-9bf2-d8bba2e97880 Jul 08 01:17:52 devstack sudo[101510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:52 devstack sudo[101510]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-281715e7-b034-4507-9bf2-d8bba2e97880" returned: 0 in 0.655s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:17:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53993d31-b1ee-4097-b96f-9067a4e2fee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-281715e7-b034-4507-9bf2-d8bba2e97880', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998ed643-af7b-43f1-93dd-0e5cfc04709b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:17:52 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Volume volume-281715e7-b034-4507-9bf2-d8bba2e97880 (281715e7-b034-4507-9bf2-d8bba2e97880): created successfully Jul 08 01:17:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (998ed643-af7b-43f1-93dd-0e5cfc04709b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:17:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Flow 'volume_create_manager' (f756be4b-0eb3-47ce-9172-22a8b59de942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:17:52 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-8b08dc59-dd21-43cd-a36e-ae58c870a6ba tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Created volume successfully. Jul 08 01:17:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-ecc3ad53-8738-4c1b-847a-21da75b37756 req-8cedb526-0876-42dc-a447-23052e7f2a91 tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:17:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-ecc3ad53-8738-4c1b-847a-21da75b37756 req-8cedb526-0876-42dc-a447-23052e7f2a91 tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:17:56 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[8954045f-40de-42bc-b8bc-aafbf3c0dca2]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:17:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-ecc3ad53-8738-4c1b-847a-21da75b37756 req-8cedb526-0876-42dc-a447-23052e7f2a91 tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-281715e7-b034-4507-9bf2-d8bba2e97880 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:17:56 devstack sudo[101550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-281715e7-b034-4507-9bf2-d8bba2e97880 Jul 08 01:17:56 devstack sudo[101550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:17:57 devstack sudo[101550]: pam_unix(sudo:session): session closed for user root Jul 08 01:17:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-ecc3ad53-8738-4c1b-847a-21da75b37756 req-8cedb526-0876-42dc-a447-23052e7f2a91 tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-281715e7-b034-4507-9bf2-d8bba2e97880" returned: 0 in 0.946s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:17:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-ecc3ad53-8738-4c1b-847a-21da75b37756 req-8cedb526-0876-42dc-a447-23052e7f2a91 tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.965s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:17:57 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-ecc3ad53-8738-4c1b-847a-21da75b37756 req-8cedb526-0876-42dc-a447-23052e7f2a91 tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e', 'name': 'volume-281715e7-b034-4507-9bf2-d8bba2e97880', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be19ceaa-8a93-46a7-8eef-ec16cb97b7bb', 'enforce_multipath': True} {{(pid=87123) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:17:57 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-ecc3ad53-8738-4c1b-847a-21da75b37756 req-8cedb526-0876-42dc-a447-23052e7f2a91 tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] attachment_update completed successfully. Jul 08 01:18:03 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-17e8323c-0a0b-485c-9c92-784e2d2a8841 req-354693fc-d8c2-4525-8a84-c8984f301fcf tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Terminate volume connection completed successfully. Jul 08 01:18:03 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-17e8323c-0a0b-485c-9c92-784e2d2a8841 req-354693fc-d8c2-4525-8a84-c8984f301fcf tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Deleting attachment be19ceaa-8a93-46a7-8eef-ec16cb97b7bb. {{(pid=87123) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:18:05 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6999d2be-cd3b-422b-a786-e61d0781c99d tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Acquiring lock "cinder-281715e7-b034-4507-9bf2-d8bba2e97880-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:18:05 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6999d2be-cd3b-422b-a786-e61d0781c99d tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Lock "cinder-281715e7-b034-4507-9bf2-d8bba2e97880-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:18:05 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6999d2be-cd3b-422b-a786-e61d0781c99d tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Acquiring lock "cinder-quobyte-281715e7-b034-4507-9bf2-d8bba2e97880" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:18:05 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6999d2be-cd3b-422b-a786-e61d0781c99d tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Lock "cinder-quobyte-281715e7-b034-4507-9bf2-d8bba2e97880" acquired by "delete_volume" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:18:05 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4fe23b-5f69-460d-9c10-210e42cc1c79]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:18:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6999d2be-cd3b-422b-a786-e61d0781c99d tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-281715e7-b034-4507-9bf2-d8bba2e97880 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:05 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-281715e7-b034-4507-9bf2-d8bba2e97880 Jul 08 01:18:05 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:06 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6999d2be-cd3b-422b-a786-e61d0781c99d tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-281715e7-b034-4507-9bf2-d8bba2e97880" returned: 0 in 0.774s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6999d2be-cd3b-422b-a786-e61d0781c99d tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-281715e7-b034-4507-9bf2-d8bba2e97880 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:06 devstack sudo[101571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-281715e7-b034-4507-9bf2-d8bba2e97880 Jul 08 01:18:06 devstack sudo[101571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:07 devstack sudo[101571]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6999d2be-cd3b-422b-a786-e61d0781c99d tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-281715e7-b034-4507-9bf2-d8bba2e97880" returned: 0 in 0.670s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6999d2be-cd3b-422b-a786-e61d0781c99d tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Lock "cinder-quobyte-281715e7-b034-4507-9bf2-d8bba2e97880" released by "delete_volume" :: held 1.487s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:18:07 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-6999d2be-cd3b-422b-a786-e61d0781c99d tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Created reservations ['549e1122-d6f4-4332-9a6c-5fbf6a4055b9', '9ac1a12e-325b-4d48-a0d6-41e090940aaa', 'e7fa725f-be3f-4c67-87a8-e558cc3068d5', '70732442-ff4f-453c-abea-b6a7e32203ac'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:18:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6999d2be-cd3b-422b-a786-e61d0781c99d tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6999d2be-cd3b-422b-a786-e61d0781c99d tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6999d2be-cd3b-422b-a786-e61d0781c99d tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:18:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6999d2be-cd3b-422b-a786-e61d0781c99d tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:18:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6999d2be-cd3b-422b-a786-e61d0781c99d tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:18:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6999d2be-cd3b-422b-a786-e61d0781c99d tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:07 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:18:07 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:08 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6999d2be-cd3b-422b-a786-e61d0781c99d tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.739s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:08 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-6999d2be-cd3b-422b-a786-e61d0781c99d tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:18:08 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-6999d2be-cd3b-422b-a786-e61d0781c99d tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Deleted volume successfully. Jul 08 01:18:08 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6999d2be-cd3b-422b-a786-e61d0781c99d tempest-TestServerVolumeAttachScenarioOldVersion-1728190255 None] Lock "cinder-281715e7-b034-4507-9bf2-d8bba2e97880-delete_volume" released by "delete_volume" :: held 2.504s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:18:17 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=15,cinder:UPDATE=14,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:18:18 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=12,cinder:INSERT=3,cinder:UPDATE=11,cinder:DELETE=1 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:18:20 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-fad24a6a-8d02-4ac0-b6f3-61c34bdcf3b3 req-4d0751bf-5c63-4dff-b11f-2e018e3daf41 tempest-TestMinimumBasicScenario-64435126 None] Terminate volume connection completed successfully. Jul 08 01:18:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-fad24a6a-8d02-4ac0-b6f3-61c34bdcf3b3 req-4d0751bf-5c63-4dff-b11f-2e018e3daf41 tempest-TestMinimumBasicScenario-64435126 None] Deleting attachment ae4d909f-b8f5-40dc-adc3-33ab14461e4f. {{(pid=87123) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:18:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1c1223f2-64ba-4d9d-ba98-3ccada6a2ac8 tempest-TestMinimumBasicScenario-64435126 None] Acquiring lock "cinder-e4c3ac58-5e86-4e83-a1b1-57b772fcf787-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:18:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1c1223f2-64ba-4d9d-ba98-3ccada6a2ac8 tempest-TestMinimumBasicScenario-64435126 None] Lock "cinder-e4c3ac58-5e86-4e83-a1b1-57b772fcf787-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:18:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1c1223f2-64ba-4d9d-ba98-3ccada6a2ac8 tempest-TestMinimumBasicScenario-64435126 None] Acquiring lock "cinder-quobyte-e4c3ac58-5e86-4e83-a1b1-57b772fcf787" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:18:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1c1223f2-64ba-4d9d-ba98-3ccada6a2ac8 tempest-TestMinimumBasicScenario-64435126 None] Lock "cinder-quobyte-e4c3ac58-5e86-4e83-a1b1-57b772fcf787" acquired by "delete_volume" :: waited 0.017s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:18:22 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc8d2a8-7987-4221-88a3-cd779377f98c]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:18:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c1223f2-64ba-4d9d-ba98-3ccada6a2ac8 tempest-TestMinimumBasicScenario-64435126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e4c3ac58-5e86-4e83-a1b1-57b772fcf787 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:22 devstack sudo[101682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e4c3ac58-5e86-4e83-a1b1-57b772fcf787 Jul 08 01:18:22 devstack sudo[101682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:23 devstack sudo[101682]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c1223f2-64ba-4d9d-ba98-3ccada6a2ac8 tempest-TestMinimumBasicScenario-64435126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e4c3ac58-5e86-4e83-a1b1-57b772fcf787" returned: 0 in 0.859s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c1223f2-64ba-4d9d-ba98-3ccada6a2ac8 tempest-TestMinimumBasicScenario-64435126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e4c3ac58-5e86-4e83-a1b1-57b772fcf787 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:23 devstack sudo[101687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e4c3ac58-5e86-4e83-a1b1-57b772fcf787 Jul 08 01:18:23 devstack sudo[101687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:24 devstack sudo[101687]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c1223f2-64ba-4d9d-ba98-3ccada6a2ac8 tempest-TestMinimumBasicScenario-64435126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e4c3ac58-5e86-4e83-a1b1-57b772fcf787" returned: 0 in 0.689s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1c1223f2-64ba-4d9d-ba98-3ccada6a2ac8 tempest-TestMinimumBasicScenario-64435126 None] Lock "cinder-quobyte-e4c3ac58-5e86-4e83-a1b1-57b772fcf787" released by "delete_volume" :: held 1.592s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:18:24 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-1c1223f2-64ba-4d9d-ba98-3ccada6a2ac8 tempest-TestMinimumBasicScenario-64435126 None] Created reservations ['5166867f-e296-4961-8762-265e263fcfd5', '45cfae3d-aaea-48b7-af3a-151017c9b5ee', 'b041f8ba-b84a-4585-b787-8fb85b1b8641', '69644ac3-b469-4d12-8482-1f6b4839286a'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:18:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c1223f2-64ba-4d9d-ba98-3ccada6a2ac8 tempest-TestMinimumBasicScenario-64435126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c1223f2-64ba-4d9d-ba98-3ccada6a2ac8 tempest-TestMinimumBasicScenario-64435126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1c1223f2-64ba-4d9d-ba98-3ccada6a2ac8 tempest-TestMinimumBasicScenario-64435126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:18:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1c1223f2-64ba-4d9d-ba98-3ccada6a2ac8 tempest-TestMinimumBasicScenario-64435126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:18:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c1223f2-64ba-4d9d-ba98-3ccada6a2ac8 tempest-TestMinimumBasicScenario-64435126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:18:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c1223f2-64ba-4d9d-ba98-3ccada6a2ac8 tempest-TestMinimumBasicScenario-64435126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:24 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:18:24 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:24 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c1223f2-64ba-4d9d-ba98-3ccada6a2ac8 tempest-TestMinimumBasicScenario-64435126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.703s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:25 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-1c1223f2-64ba-4d9d-ba98-3ccada6a2ac8 tempest-TestMinimumBasicScenario-64435126 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:18:25 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-1c1223f2-64ba-4d9d-ba98-3ccada6a2ac8 tempest-TestMinimumBasicScenario-64435126 None] Deleted volume successfully. Jul 08 01:18:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1c1223f2-64ba-4d9d-ba98-3ccada6a2ac8 tempest-TestMinimumBasicScenario-64435126 None] Lock "cinder-e4c3ac58-5e86-4e83-a1b1-57b772fcf787-delete_volume" released by "delete_volume" :: held 2.621s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:18:34 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=6 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:18:35 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:18:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:18:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:18:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:18:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:18:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:44 devstack sudo[101727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:18:44 devstack sudo[101727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:45 devstack sudo[101727]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.773s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:45 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:18:45 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:18:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 28 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:18:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:18:50 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:18:50 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Flow 'volume_create_manager' (fdb04618-1b8c-4cd7-9131-ef2b4d467bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:18:50 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb44aac-fa3e-491a-b7ae-0ecdb8c5564e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:50 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7eb44aac-fa3e-491a-b7ae-0ecdb8c5564e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1513408417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd6b149-c610-4a0d-8fea-18f189722ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6aac7afe6724e5f84d2b17adbb2df03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:18:51Z,use_quota=True,user_id='a355c098aec147f6885b271557eea612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:50 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d0cf85-9fd3-4ef3-8e07-89d5d9384507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:50 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12d0cf85-9fd3-4ef3-8e07-89d5d9384507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:50 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a530d1a-fc82-4661-ba19-9b9379d02b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:50 devstack cinder-volume[87123]: DEBUG cinder.image.glance [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Creating Keystone auth plugin from conf {{(pid=87123) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:18:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a530d1a-fc82-4661-ba19-9b9379d02b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6dd6b149-c610-4a0d-8fea-18f189722ae7', 'volume_name': 'volume-6dd6b149-c610-4a0d-8fea-18f189722ae7', 'volume_size': 1, 'image_id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '464063acafa44f9e90fd1bca62b64e8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'created_at': datetime.datetime(2026, 7, 7, 22, 51, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 51, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c6083d2-ddf8-4961-8d2c-8d37ad3dc58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c6083d2-ddf8-4961-8d2c-8d37ad3dc58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:18:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0765a5f3-0aad-415d-b8dc-659b7398fffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:18:51 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Volume 6dd6b149-c610-4a0d-8fea-18f189722ae7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6dd6b149-c610-4a0d-8fea-18f189722ae7', 'volume_size': 1, 'image_id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '464063acafa44f9e90fd1bca62b64e8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'created_at': datetime.datetime(2026, 7, 7, 22, 51, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 51, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 08 01:18:51 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Trying to clone 6dd6b149-c610-4a0d-8fea-18f189722ae7 from image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d at location (None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}]). {{(pid=87123) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:18:51 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_1g3_qdy3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:18:51 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Image download 20.69 MB at 20.69 MB/s Jul 08 01:18:51 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b4d74c-d220-4044-af33-b0d1159b1f30]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:18:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_1g3_qdy3devstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:51 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_1g3_qdy3devstack@QuobyteHD Jul 08 01:18:51 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:52 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_1g3_qdy3devstack@QuobyteHD" returned: 0 in 0.851s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:52 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Temporary image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d is fetched for user a355c098aec147f6885b271557eea612. {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:18:52 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ebb2f8a-07eb-4866-a78b-392c0ba5e86b]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:18:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_1g3_qdy3devstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:52 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_1g3_qdy3devstack@QuobyteHD Jul 08 01:18:52 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:53 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_1g3_qdy3devstack@QuobyteHD" returned: 0 in 0.829s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:53 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:18:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1513408417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dd6b149-c610-4a0d-8fea-18f189722ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6aac7afe6724e5f84d2b17adbb2df03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:18:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:18:51Z,use_quota=True,user_id='a355c098aec147f6885b271557eea612',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:18:53 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Creating volume 6dd6b149-c610-4a0d-8fea-18f189722ae7 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:18:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:18:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:18:53 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:18:53 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:18:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:18:53 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:18:53 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:18:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:53 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 1073741824 Jul 08 01:18:53 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:54 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 1073741824" returned: 0 in 0.848s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:54 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 Jul 08 01:18:54 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:55 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7" returned: 0 in 0.681s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:18:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:18:55 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Attempting download of 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d ((None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}])) to volume 6dd6b149-c610-4a0d-8fea-18f189722ae7. {{(pid=87123) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:18:55 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[a965d03b-563a-40eb-9736-b0b9419ec158]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:18:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_5iszc7te {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:55 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_5iszc7te Jul 08 01:18:55 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:56 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_5iszc7te" returned: 0 in 0.818s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_5iszc7te {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:56 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_5iszc7te Jul 08 01:18:56 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:56 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_5iszc7te" returned: 1 in 0.783s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_5iszc7te' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:18:56 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e9c2d0-f320-4fef-ab70-53c42486c528]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:18:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_1g3_qdy3devstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:57 devstack sudo[101762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_1g3_qdy3devstack@QuobyteHD Jul 08 01:18:57 devstack sudo[101762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:57 devstack sudo[101762]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_1g3_qdy3devstack@QuobyteHD" returned: 0 in 0.833s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:57 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d was qcow2, converting to raw {{(pid=87123) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:18:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_1g3_qdy3devstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:57 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_1g3_qdy3devstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 Jul 08 01:18:57 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:18:59 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Jul 08 01:18:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_1g3_qdy3devstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7" returned: 0 in 2.105s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:18:59 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1f0809f9-48e9-4251-ae1f-0f8eed7fa95d_1g3_qdy3devstack@QuobyteHD, size 112.00 MB, duration 2.11 sec, destination /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:18:59 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Converted 112.00 MB image at 53.17 MB/s Jul 08 01:18:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:18:59 devstack sudo[101776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 1G Jul 08 01:18:59 devstack sudo[101776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:00 devstack sudo[101776]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 1G" returned: 0 in 0.737s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:00 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[572afe3f-1e5c-44b0-bd17-23e94a932f75]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:19:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:00 devstack sudo[101781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 Jul 08 01:19:00 devstack sudo[101781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:01 devstack sudo[101781]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7" returned: 0 in 0.839s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:01 devstack sudo[101786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 Jul 08 01:19:01 devstack sudo[101786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:02 devstack sudo[101786]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7" returned: 1 in 0.900s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:19:02 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Downloaded image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d ((None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}])) to volume 6dd6b149-c610-4a0d-8fea-18f189722ae7 successfully. {{(pid=87123) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:19:02 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Temporary image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d for user a355c098aec147f6885b271557eea612 is deleted. {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:19:02 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Marking volume 6dd6b149-c610-4a0d-8fea-18f189722ae7 as bootable. {{(pid=87123) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:19:02 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Copying metadata from image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d to 6dd6b149-c610-4a0d-8fea-18f189722ae7. {{(pid=87123) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:19:02 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Creating volume glance metadata for volume 6dd6b149-c610-4a0d-8fea-18f189722ae7 backed by image 1f0809f9-48e9-4251-ae1f-0f8eed7fa95d with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87123) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:19:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0765a5f3-0aad-415d-b8dc-659b7398fffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dd6b149-c610-4a0d-8fea-18f189722ae7', 'volume_size': 1, 'image_id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '464063acafa44f9e90fd1bca62b64e8b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '1f0809f9-48e9-4251-ae1f-0f8eed7fa95d', 'created_at': datetime.datetime(2026, 7, 7, 22, 51, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 22, 51, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1f0809f9-48e9-4251-ae1f-0f8eed7fa95d/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f99170-2a38-4800-af04-666dbff31cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:02 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Volume volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 (6dd6b149-c610-4a0d-8fea-18f189722ae7): created successfully Jul 08 01:19:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f99170-2a38-4800-af04-666dbff31cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Flow 'volume_create_manager' (fdb04618-1b8c-4cd7-9131-ef2b4d467bdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:19:02 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-a679e495-b9b2-4e31-b8db-9f65259b53cd tempest-TestShelveInstance-922827654 None] Created volume successfully. Jul 08 01:19:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-158edd6e-2517-44aa-8fc1-37156c2d9d08 req-d2eabb5c-9afa-4ad9-bf28-e18211df55f1 tempest-TestShelveInstance-922827654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-158edd6e-2517-44aa-8fc1-37156c2d9d08 req-d2eabb5c-9afa-4ad9-bf28-e18211df55f1 tempest-TestShelveInstance-922827654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:11 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc456389-002b-47d0-9e83-39c142c88325]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:19:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-158edd6e-2517-44aa-8fc1-37156c2d9d08 req-d2eabb5c-9afa-4ad9-bf28-e18211df55f1 tempest-TestShelveInstance-922827654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:11 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 Jul 08 01:19:11 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:12 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-158edd6e-2517-44aa-8fc1-37156c2d9d08 req-d2eabb5c-9afa-4ad9-bf28-e18211df55f1 tempest-TestShelveInstance-922827654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7" returned: 0 in 1.022s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-158edd6e-2517-44aa-8fc1-37156c2d9d08 req-d2eabb5c-9afa-4ad9-bf28-e18211df55f1 tempest-TestShelveInstance-922827654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:12 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:19:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Flow 'volume_create_manager' (79287a9a-647d-4839-939e-b6e93e80c4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:19:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00317f8d-5861-48b9-b3d3-45aa15cdde65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00317f8d-5861-48b9-b3d3-45aa15cdde65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1052614130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e185660-2bc7-496c-b883-ddfeeef7235a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2701588724f34a409b3d9e600108044a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:19:12Z,use_quota=True,user_id='7f08abeac14f4cb69f2e6a56a55efc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:12 devstack sudo[101810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 Jul 08 01:19:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26dc77e4-b3c2-4ac5-8758-c01e81fdf3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:12 devstack sudo[101810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26dc77e4-b3c2-4ac5-8758-c01e81fdf3f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d855df79-ce6e-4125-9bfd-1f13c7cdf676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d855df79-ce6e-4125-9bfd-1f13c7cdf676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e185660-2bc7-496c-b883-ddfeeef7235a', 'volume_name': 'volume-1e185660-2bc7-496c-b883-ddfeeef7235a', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7811701a-9a6a-4241-83d1-460b399c6588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7811701a-9a6a-4241-83d1-460b399c6588) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:12 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a837ef60-d4b8-4611-b52e-109b8ff4accf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:12 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Volume 1e185660-2bc7-496c-b883-ddfeeef7235a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e185660-2bc7-496c-b883-ddfeeef7235a', 'volume_size': 1} Jul 08 01:19:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:13 devstack sudo[101810]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-158edd6e-2517-44aa-8fc1-37156c2d9d08 req-d2eabb5c-9afa-4ad9-bf28-e18211df55f1 tempest-TestShelveInstance-922827654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7" returned: 1 in 1.030s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-158edd6e-2517-44aa-8fc1-37156c2d9d08 req-d2eabb5c-9afa-4ad9-bf28-e18211df55f1 tempest-TestShelveInstance-922827654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:19:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-158edd6e-2517-44aa-8fc1-37156c2d9d08 req-d2eabb5c-9afa-4ad9-bf28-e18211df55f1 tempest-TestShelveInstance-922827654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.125s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.833s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1052614130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e185660-2bc7-496c-b883-ddfeeef7235a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2701588724f34a409b3d9e600108044a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:19:12Z,use_quota=True,user_id='7f08abeac14f4cb69f2e6a56a55efc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:19:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Creating volume 1e185660-2bc7-496c-b883-ddfeeef7235a {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:19:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:19:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:19:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:19:13 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:19:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:13 devstack sudo[101818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a 1073741824 Jul 08 01:19:13 devstack sudo[101818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-158edd6e-2517-44aa-8fc1-37156c2d9d08 req-d2eabb5c-9afa-4ad9-bf28-e18211df55f1 tempest-TestShelveInstance-922827654 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e', 'name': 'volume-6dd6b149-c610-4a0d-8fea-18f189722ae7', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'af39e158-acae-4764-8435-dc0502d8a450', 'enforce_multipath': True} {{(pid=87123) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:19:13 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-158edd6e-2517-44aa-8fc1-37156c2d9d08 req-d2eabb5c-9afa-4ad9-bf28-e18211df55f1 tempest-TestShelveInstance-922827654 None] attachment_update completed successfully. Jul 08 01:19:14 devstack sudo[101818]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a 1073741824" returned: 0 in 1.010s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:14 devstack sudo[101824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a Jul 08 01:19:14 devstack sudo[101824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:15 devstack sudo[101824]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a" returned: 0 in 0.677s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:19:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.806s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a837ef60-d4b8-4611-b52e-109b8ff4accf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e185660-2bc7-496c-b883-ddfeeef7235a', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f90b3b22-ed7d-4819-b8c1-459f01d7a8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:19:15 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Volume volume-1e185660-2bc7-496c-b883-ddfeeef7235a (1e185660-2bc7-496c-b883-ddfeeef7235a): created successfully Jul 08 01:19:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f90b3b22-ed7d-4819-b8c1-459f01d7a8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:19:15 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Flow 'volume_create_manager' (79287a9a-647d-4839-939e-b6e93e80c4fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:19:15 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-c017f25e-f595-4052-a215-9b04375654c6 tempest-TestStampPattern-2032631778 None] Created volume successfully. Jul 08 01:19:25 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=17,cinder:INSERT=9,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:19:25 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:UPDATE=9,cinder:SELECT=18,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:19:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:19:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:19:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:19:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:44 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:19:44 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:45 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.666s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:45 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:19:45 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:19:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 28 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:19:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:19:51 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-f71174fa-e1b4-4f1d-a32f-5b479fc30215 req-2e2790a9-d04f-4d88-be0c-fff395b7784d tempest-TestShelveInstance-922827654 None] Terminate volume connection completed successfully. Jul 08 01:19:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-f71174fa-e1b4-4f1d-a32f-5b479fc30215 req-2e2790a9-d04f-4d88-be0c-fff395b7784d tempest-TestShelveInstance-922827654 None] Deleting attachment af39e158-acae-4764-8435-dc0502d8a450. {{(pid=87123) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:19:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-3e622914-ff96-43be-96f5-820e0bea9d41 req-441ab09f-e63b-4883-9bd8-2377000457e8 tempest-TestStampPattern-2032631778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-3e622914-ff96-43be-96f5-820e0bea9d41 req-441ab09f-e63b-4883-9bd8-2377000457e8 tempest-TestStampPattern-2032631778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:54 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ded6502-6de5-4e97-a139-b7571fd412be]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:19:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-3e622914-ff96-43be-96f5-820e0bea9d41 req-441ab09f-e63b-4883-9bd8-2377000457e8 tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:54 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a Jul 08 01:19:54 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:55 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-3e622914-ff96-43be-96f5-820e0bea9d41 req-441ab09f-e63b-4883-9bd8-2377000457e8 tempest-TestStampPattern-2032631778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a" returned: 0 in 0.842s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-3e622914-ff96-43be-96f5-820e0bea9d41 req-441ab09f-e63b-4883-9bd8-2377000457e8 tempest-TestStampPattern-2032631778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.864s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:55 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-3e622914-ff96-43be-96f5-820e0bea9d41 req-441ab09f-e63b-4883-9bd8-2377000457e8 tempest-TestStampPattern-2032631778 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e', 'name': 'volume-1e185660-2bc7-496c-b883-ddfeeef7235a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6319f63-4ab0-4998-8cb3-e3b2f62166d0', 'enforce_multipath': True} {{(pid=87123) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:19:55 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-3e622914-ff96-43be-96f5-820e0bea9d41 req-441ab09f-e63b-4883-9bd8-2377000457e8 tempest-TestStampPattern-2032631778 None] attachment_update completed successfully. Jul 08 01:19:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-0fc5d548-9489-4eeb-9fd8-262b46c08668 req-1609507f-aa72-4893-9712-f8a3019869a1 tempest-TestShelveInstance-922827654 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:19:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-0fc5d548-9489-4eeb-9fd8-262b46c08668 req-1609507f-aa72-4893-9712-f8a3019869a1 tempest-TestShelveInstance-922827654 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:19:56 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[9672e9d3-d8f0-47b1-8363-377a643015b9]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:19:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-0fc5d548-9489-4eeb-9fd8-262b46c08668 req-1609507f-aa72-4893-9712-f8a3019869a1 tempest-TestShelveInstance-922827654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:56 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 Jul 08 01:19:56 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:57 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-0fc5d548-9489-4eeb-9fd8-262b46c08668 req-1609507f-aa72-4893-9712-f8a3019869a1 tempest-TestShelveInstance-922827654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7" returned: 0 in 0.774s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-0fc5d548-9489-4eeb-9fd8-262b46c08668 req-1609507f-aa72-4893-9712-f8a3019869a1 tempest-TestShelveInstance-922827654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:19:57 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 Jul 08 01:19:57 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:19:58 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Jul 08 01:19:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-0fc5d548-9489-4eeb-9fd8-262b46c08668 req-1609507f-aa72-4893-9712-f8a3019869a1 tempest-TestShelveInstance-922827654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7" returned: 1 in 0.778s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:19:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-0fc5d548-9489-4eeb-9fd8-262b46c08668 req-1609507f-aa72-4893-9712-f8a3019869a1 tempest-TestShelveInstance-922827654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:19:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-0fc5d548-9489-4eeb-9fd8-262b46c08668 req-1609507f-aa72-4893-9712-f8a3019869a1 tempest-TestShelveInstance-922827654 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.595s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:19:58 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-0fc5d548-9489-4eeb-9fd8-262b46c08668 req-1609507f-aa72-4893-9712-f8a3019869a1 tempest-TestShelveInstance-922827654 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e', 'name': 'volume-6dd6b149-c610-4a0d-8fea-18f189722ae7', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '472d29cf-936c-4c01-9f6f-1466fcb5d201', 'enforce_multipath': True} {{(pid=87123) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:19:58 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-0fc5d548-9489-4eeb-9fd8-262b46c08668 req-1609507f-aa72-4893-9712-f8a3019869a1 tempest-TestShelveInstance-922827654 None] attachment_update completed successfully. Jul 08 01:20:03 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-00e50587-7bbf-4518-8b50-b4338e1d3631 req-75714a26-5902-4d94-872b-c076eaa731af tempest-TestStampPattern-2032631778 None] Terminate volume connection completed successfully. Jul 08 01:20:03 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-00e50587-7bbf-4518-8b50-b4338e1d3631 req-75714a26-5902-4d94-872b-c076eaa731af tempest-TestStampPattern-2032631778 None] Deleting attachment c6319f63-4ab0-4998-8cb3-e3b2f62166d0. {{(pid=87123) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:20:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f8ef0345-3f33-490b-b39f-9020f1516fb8 tempest-TestStampPattern-2032631778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f8ef0345-3f33-490b-b39f-9020f1516fb8 tempest-TestStampPattern-2032631778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:05 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f8ef0345-3f33-490b-b39f-9020f1516fb8 tempest-TestStampPattern-2032631778 None] Creating offline snapshot ea2e8b51-c588-45db-b921-236155c09031 of volume 1e185660-2bc7-496c-b883-ddfeeef7235a {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:20:05 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ef9503-5de1-4d9e-803b-4e4f5e5c857f]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f8ef0345-3f33-490b-b39f-9020f1516fb8 tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:06 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a Jul 08 01:20:06 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:06 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f8ef0345-3f33-490b-b39f-9020f1516fb8 tempest-TestStampPattern-2032631778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a" returned: 0 in 0.833s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f8ef0345-3f33-490b-b39f-9020f1516fb8 tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:06 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031 1G Jul 08 01:20:06 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:07 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f8ef0345-3f33-490b-b39f-9020f1516fb8 tempest-TestStampPattern-2032631778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031 1G" returned: 0 in 0.944s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f8ef0345-3f33-490b-b39f-9020f1516fb8 tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e185660-2bc7-496c-b883-ddfeeef7235a -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:07 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e185660-2bc7-496c-b883-ddfeeef7235a -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031 Jul 08 01:20:07 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:08 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f8ef0345-3f33-490b-b39f-9020f1516fb8 tempest-TestStampPattern-2032631778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e185660-2bc7-496c-b883-ddfeeef7235a -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031" returned: 0 in 0.836s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:08 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-f8ef0345-3f33-490b-b39f-9020f1516fb8 tempest-TestStampPattern-2032631778 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031 is being set with open permissions: ugo+rw Jul 08 01:20:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f8ef0345-3f33-490b-b39f-9020f1516fb8 tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:08 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031 Jul 08 01:20:08 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:09 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f8ef0345-3f33-490b-b39f-9020f1516fb8 tempest-TestStampPattern-2032631778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031" returned: 0 in 0.684s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f8ef0345-3f33-490b-b39f-9020f1516fb8 tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:09 devstack sudo[103496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.info Jul 08 01:20:09 devstack sudo[103496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:09 devstack sudo[103496]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f8ef0345-3f33-490b-b39f-9020f1516fb8 tempest-TestStampPattern-2032631778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.info" returned: 0 in 0.677s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:09 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-f8ef0345-3f33-490b-b39f-9020f1516fb8 tempest-TestStampPattern-2032631778 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.info is being set with open permissions: ugo+rw Jul 08 01:20:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f8ef0345-3f33-490b-b39f-9020f1516fb8 tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:09 devstack sudo[103506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.info Jul 08 01:20:09 devstack sudo[103506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:10 devstack sudo[103506]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f8ef0345-3f33-490b-b39f-9020f1516fb8 tempest-TestStampPattern-2032631778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.info" returned: 0 in 0.737s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f8ef0345-3f33-490b-b39f-9020f1516fb8 tempest-TestStampPattern-2032631778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.821s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:10 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f8ef0345-3f33-490b-b39f-9020f1516fb8 tempest-TestStampPattern-2032631778 None] Create snapshot completed successfully Jul 08 01:20:20 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=17,cinder:UPDATE=4 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:20:20 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=16,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Flow 'volume_create_manager' (e93c18d5-50a4-4b65-9554-b6f4dada517b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349652d3-608a-4953-85a1-d8c84c9adb47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (349652d3-608a-4953-85a1-d8c84c9adb47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1628943315',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ac7f2cb-a4d1-41e9-a827-469de153da63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2701588724f34a409b3d9e600108044a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ea2e8b51-c588-45db-b921-236155c09031,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:20:21Z,use_quota=True,user_id='7f08abeac14f4cb69f2e6a56a55efc31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff768bd-8411-4e25-bf7e-98ec4bb516e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ff768bd-8411-4e25-bf7e-98ec4bb516e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337f676d-7c2b-4780-8fa2-19fba108b0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (337f676d-7c2b-4780-8fa2-19fba108b0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9ac7f2cb-a4d1-41e9-a827-469de153da63', 'volume_name': 'volume-9ac7f2cb-a4d1-41e9-a827-469de153da63', 'volume_size': 1, 'snapshot_id': 'ea2e8b51-c588-45db-b921-236155c09031'}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec99dfb-c61d-4bd8-86ff-3e67c9ae603b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ec99dfb-c61d-4bd8-86ff-3e67c9ae603b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5329d694-542e-44d4-a83a-17257d8d6cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:21 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Volume 9ac7f2cb-a4d1-41e9-a827-469de153da63: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9ac7f2cb-a4d1-41e9-a827-469de153da63', 'volume_size': 1, 'snapshot_id': 'ea2e8b51-c588-45db-b921-236155c09031'} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Acquiring lock "cinder-quobyte-ea2e8b51-c588-45db-b921-236155c09031-9ac7f2cb-a4d1-41e9-a827-469de153da63" by "_create_volume_from_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Lock "cinder-quobyte-ea2e8b51-c588-45db-b921-236155c09031-9ac7f2cb-a4d1-41e9-a827-469de153da63" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Creating volume 9ac7f2cb-a4d1-41e9-a827-469de153da63 from snapshot ea2e8b51-c588-45db-b921-236155c09031 {{(pid=87123) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Acquiring lock "cinder-quobyte-9ac7f2cb-a4d1-41e9-a827-469de153da63" by "_copy_volume_from_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Lock "cinder-quobyte-9ac7f2cb-a4d1-41e9-a827-469de153da63" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] snapshot: ea2e8b51-c588-45db-b921-236155c09031, volume: 9ac7f2cb-a4d1-41e9-a827-469de153da63, {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d510c380-a3db-4bde-b519-25c7ef92470f]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:21 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031 Jul 08 01:20:21 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:22 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031" returned: 0 in 0.877s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:22 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e185660-2bc7-496c-b883-ddfeeef7235a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:20:22 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:20:22 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Creating direct copy from snapshot {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:20:22 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad016649-8422-4280-9768-9888109c384d]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:22 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a Jul 08 01:20:22 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:23 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a" returned: 0 in 0.860s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:23 devstack cinder-volume[87123]: DEBUG cinder.utils [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Path /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9ac7f2cb-a4d1-41e9-a827-469de153da63 not found in is_blk_device check {{(pid=87123) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:20:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9ac7f2cb-a4d1-41e9-a827-469de153da63 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:23 devstack sudo[103604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9ac7f2cb-a4d1-41e9-a827-469de153da63 Jul 08 01:20:23 devstack sudo[103604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:28 devstack sudo[103604]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9ac7f2cb-a4d1-41e9-a827-469de153da63" returned: 0 in 5.162s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:28 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40037b2-6236-4dd3-9396-058c5185607b]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:28 devstack sudo[103650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a Jul 08 01:20:28 devstack sudo[103650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:29 devstack sudo[103650]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a" returned: 0 in 1.224s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:29 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Image conversion details: src /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a, size 1024.00 MB, duration 5.16 sec, destination /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9ac7f2cb-a4d1-41e9-a827-469de153da63 {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:20:29 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Converted 1024.00 MB image at 198.33 MB/s Jul 08 01:20:29 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9ac7f2cb-a4d1-41e9-a827-469de153da63 is being set with open permissions: ugo+rw Jul 08 01:20:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9ac7f2cb-a4d1-41e9-a827-469de153da63 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:29 devstack sudo[103656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9ac7f2cb-a4d1-41e9-a827-469de153da63 Jul 08 01:20:29 devstack sudo[103656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:30 devstack sudo[103656]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9ac7f2cb-a4d1-41e9-a827-469de153da63" returned: 0 in 0.748s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:30 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Lock "cinder-quobyte-9ac7f2cb-a4d1-41e9-a827-469de153da63" released by "_copy_volume_from_snapshot" :: held 8.982s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:20:30 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Lock "cinder-quobyte-ea2e8b51-c588-45db-b921-236155c09031-9ac7f2cb-a4d1-41e9-a827-469de153da63" released by "_create_volume_from_snapshot" :: held 9.031s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:20:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.048s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5329d694-542e-44d4-a83a-17257d8d6cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ac7f2cb-a4d1-41e9-a827-469de153da63', 'volume_size': 1, 'snapshot_id': 'ea2e8b51-c588-45db-b921-236155c09031'}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b966af-f5d5-4f82-8103-1c1f85217f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:20:30 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Volume volume-9ac7f2cb-a4d1-41e9-a827-469de153da63 (9ac7f2cb-a4d1-41e9-a827-469de153da63): created successfully Jul 08 01:20:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10b966af-f5d5-4f82-8103-1c1f85217f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:20:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Flow 'volume_create_manager' (e93c18d5-50a4-4b65-9554-b6f4dada517b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:20:30 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-738d0b6b-563c-4831-8593-ba99be81a423 tempest-TestStampPattern-2032631778 None] Created volume successfully. Jul 08 01:20:40 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:20:40 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=2,cinder:DELETE=1 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:20:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:20:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:20:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:20:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:44 devstack sudo[103733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:20:44 devstack sudo[103733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:45 devstack sudo[103733]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.743s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:45 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:20:45 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:20:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 28 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:20:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:20:51 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-3e41b543-147b-4283-978c-ef6a2aa6b0d7 tempest-TestShelveInstance-922827654 None] Terminate volume connection completed successfully. Jul 08 01:20:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-3e41b543-147b-4283-978c-ef6a2aa6b0d7 tempest-TestShelveInstance-922827654 None] Deleting attachment 472d29cf-936c-4c01-9f6f-1466fcb5d201. {{(pid=87123) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:20:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] Acquiring lock "cinder-6dd6b149-c610-4a0d-8fea-18f189722ae7-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:20:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] Lock "cinder-6dd6b149-c610-4a0d-8fea-18f189722ae7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:20:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] Acquiring lock "cinder-quobyte-6dd6b149-c610-4a0d-8fea-18f189722ae7" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:20:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] Lock "cinder-quobyte-6dd6b149-c610-4a0d-8fea-18f189722ae7" acquired by "delete_volume" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:20:52 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f2b3897-2bde-49ed-b186-c462fdc6d7b9]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:20:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:52 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 Jul 08 01:20:52 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:53 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7" returned: 0 in 0.856s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:53 devstack sudo[103781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 Jul 08 01:20:53 devstack sudo[103781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:54 devstack sudo[103781]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7" returned: 1 in 0.814s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:20:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:54 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7 Jul 08 01:20:54 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:54 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-6dd6b149-c610-4a0d-8fea-18f189722ae7" returned: 0 in 0.702s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] Lock "cinder-quobyte-6dd6b149-c610-4a0d-8fea-18f189722ae7" released by "delete_volume" :: held 2.441s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:20:55 devstack cinder-volume[87123]: DEBUG cinder.quota [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] Created reservations ['1ad8ef41-d5c5-4690-948e-fe89cfeb78d8', '7cc2c156-ab25-4d36-a0c5-1e1f650b276d', 'cbe55188-0a98-4b2f-a369-6c8584917207', 'e95d3891-bea6-4ce9-9597-028c651dd085'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:20:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:20:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:20:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:20:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:20:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:20:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:20:55 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:20:55 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:20:55 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Jul 08 01:20:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.763s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:20:55 devstack cinder-volume[87123]: DEBUG cinder.manager [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:20:55 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] Deleted volume successfully. Jul 08 01:20:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [req-00cc20ee-3a88-4b02-ae3c-baa0fb2a2e37 req-68d29509-d059-471b-a3c1-c0e1a9aa4096 tempest-TestShelveInstance-922827654 None] Lock "cinder-6dd6b149-c610-4a0d-8fea-18f189722ae7-delete_volume" released by "delete_volume" :: held 3.454s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:06 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=7 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:21:06 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:21:08 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:21:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Flow 'volume_create_manager' (95972bb9-9a92-4f36-8cda-d16c23ce3fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:21:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66ea6e5-f7c4-4e3f-bdf7-1b14d457a756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f66ea6e5-f7c4-4e3f-bdf7-1b14d457a756) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a10425-4f51-4da1-8e52-738f15b0cd5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c26804bbcf2466c95484f7cf19f7c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:21:09Z,use_quota=True,user_id='975fb5d379104db49cf1453caa3746c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3adeaa79-a985-49e6-8ac4-b9baa4a2567b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3adeaa79-a985-49e6-8ac4-b9baa4a2567b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe72049a-4e03-433e-b2cf-b7ebb08b9b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:08 devstack cinder-volume[87123]: DEBUG cinder.image.glance [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Creating Keystone auth plugin from conf {{(pid=87123) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:21:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe72049a-4e03-433e-b2cf-b7ebb08b9b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b6a10425-4f51-4da1-8e52-738f15b0cd5c', 'volume_name': 'volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c', 'volume_size': 1, 'image_id': 'bc444aca-2a0b-4228-a1b9-ae952a7d34e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc444aca-2a0b-4228-a1b9-ae952a7d34e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '34cfe05cde1951d912f77731af13d3c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2c26804bbcf2466c95484f7cf19f7c63', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '658a9129620bf29df2fe5899270e03e80293dd17922351e959fb45cc7b7605c822b93abeaf5f40542129c4639979f8790aac0fb2576d73f990cfc6f0bdd32077', 'id': 'bc444aca-2a0b-4228-a1b9-ae952a7d34e6', 'created_at': datetime.datetime(2026, 7, 7, 23, 21, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 21, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc444aca-2a0b-4228-a1b9-ae952a7d34e6/file', 'properties': {}}, 'image_service': }' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480e7efa-1eb6-46a3-ac78-bce16abce6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480e7efa-1eb6-46a3-ac78-bce16abce6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (238fd944-8304-4129-b0f1-2666bc4910b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:09 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Volume b6a10425-4f51-4da1-8e52-738f15b0cd5c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c', 'volume_size': 1, 'image_id': 'bc444aca-2a0b-4228-a1b9-ae952a7d34e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc444aca-2a0b-4228-a1b9-ae952a7d34e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '34cfe05cde1951d912f77731af13d3c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2c26804bbcf2466c95484f7cf19f7c63', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '658a9129620bf29df2fe5899270e03e80293dd17922351e959fb45cc7b7605c822b93abeaf5f40542129c4639979f8790aac0fb2576d73f990cfc6f0bdd32077', 'id': 'bc444aca-2a0b-4228-a1b9-ae952a7d34e6', 'created_at': datetime.datetime(2026, 7, 7, 23, 21, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 21, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc444aca-2a0b-4228-a1b9-ae952a7d34e6/file', 'properties': {}}, 'image_service': } Jul 08 01:21:09 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Trying to clone b6a10425-4f51-4da1-8e52-738f15b0cd5c from image bc444aca-2a0b-4228-a1b9-ae952a7d34e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/bc444aca-2a0b-4228-a1b9-ae952a7d34e6', 'metadata': {}}]). {{(pid=87123) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:21:09 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:21:09 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Image download 0.00 MB at 0.00 MB/s Jul 08 01:21:09 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebafeca-4206-44b9-a7de-edbcd3570a52]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:09 devstack sudo[103797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD Jul 08 01:21:09 devstack sudo[103797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:10 devstack sudo[103797]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD" returned: 0 in 0.799s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:10 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD Jul 08 01:21:10 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:10 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD" returned: 1 in 0.782s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:21:10 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Temporary image bc444aca-2a0b-4228-a1b9-ae952a7d34e6 is fetched for user 975fb5d379104db49cf1453caa3746c2. {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:21:10 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85fff07-e8e8-4838-a151-855cf3aab1a1]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:11 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD Jul 08 01:21:11 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:11 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD" returned: 0 in 0.730s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:11 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD Jul 08 01:21:11 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:12 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD" returned: 1 in 0.757s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:21:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:21:09Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6a10425-4f51-4da1-8e52-738f15b0cd5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c26804bbcf2466c95484f7cf19f7c63',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:21:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:21:09Z,use_quota=True,user_id='975fb5d379104db49cf1453caa3746c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:21:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Creating volume b6a10425-4f51-4da1-8e52-738f15b0cd5c {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:21:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:12 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:21:12 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:21:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:12 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c 1073741824 Jul 08 01:21:12 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:13 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c 1073741824" returned: 0 in 0.833s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:13 devstack sudo[103822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c Jul 08 01:21:13 devstack sudo[103822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:14 devstack sudo[103822]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c" returned: 0 in 0.645s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:14 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:21:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:14 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Attempting download of bc444aca-2a0b-4228-a1b9-ae952a7d34e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/bc444aca-2a0b-4228-a1b9-ae952a7d34e6', 'metadata': {}}])) to volume b6a10425-4f51-4da1-8e52-738f15b0cd5c. {{(pid=87123) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:21:14 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe037419-7708-4f98-877a-d8bd09510f26]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_5pc6cgm0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:14 devstack sudo[103825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_5pc6cgm0 Jul 08 01:21:14 devstack sudo[103825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:14 devstack sudo[103825]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_5pc6cgm0" returned: 0 in 0.712s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_5pc6cgm0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:14 devstack sudo[103830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_5pc6cgm0 Jul 08 01:21:14 devstack sudo[103830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:15 devstack sudo[103830]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_5pc6cgm0" returned: 1 in 0.784s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_5pc6cgm0' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:21:15 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f612ba3-ff18-4207-a3a2-8e317a43fba8]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:15 devstack sudo[103839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD Jul 08 01:21:15 devstack sudo[103839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:16 devstack sudo[103839]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD" returned: 0 in 0.709s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:16 devstack sudo[103859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD Jul 08 01:21:16 devstack sudo[103859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:16 devstack sudo[103859]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD" returned: 1 in 0.704s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:21:17 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] bc444aca-2a0b-4228-a1b9-ae952a7d34e6 was raw, converting to raw {{(pid=87123) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:21:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:17 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c Jul 08 01:21:17 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:17 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c" returned: 0 in 0.843s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:17 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_bc444aca-2a0b-4228-a1b9-ae952a7d34e6_vp4fi2_idevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:21:17 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 01:21:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:17 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c 1G Jul 08 01:21:17 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:18 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c 1G" returned: 0 in 0.724s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:18 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[96b59a7e-0a90-4fdb-a8d5-a09dad96d015]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:18 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c Jul 08 01:21:18 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-41b0ac7c-623c-4819-8dee-ae60f04835cc req-786ecff0-8d11-4918-9127-be230614dac2 tempest-TestStampPattern-2032631778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-41b0ac7c-623c-4819-8dee-ae60f04835cc req-786ecff0-8d11-4918-9127-be230614dac2 tempest-TestStampPattern-2032631778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:19 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[603d48f7-e53d-4d13-ade8-17e352ced8f7]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-41b0ac7c-623c-4819-8dee-ae60f04835cc req-786ecff0-8d11-4918-9127-be230614dac2 tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9ac7f2cb-a4d1-41e9-a827-469de153da63 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:19 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c" returned: 0 in 0.859s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:19 devstack sudo[103922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9ac7f2cb-a4d1-41e9-a827-469de153da63 Jul 08 01:21:19 devstack sudo[103922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:19 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c Jul 08 01:21:19 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:20 devstack sudo[103922]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [req-41b0ac7c-623c-4819-8dee-ae60f04835cc req-786ecff0-8d11-4918-9127-be230614dac2 tempest-TestStampPattern-2032631778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9ac7f2cb-a4d1-41e9-a827-469de153da63" returned: 0 in 0.855s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [req-41b0ac7c-623c-4819-8dee-ae60f04835cc req-786ecff0-8d11-4918-9127-be230614dac2 tempest-TestStampPattern-2032631778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.873s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-41b0ac7c-623c-4819-8dee-ae60f04835cc req-786ecff0-8d11-4918-9127-be230614dac2 tempest-TestStampPattern-2032631778 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e', 'name': 'volume-9ac7f2cb-a4d1-41e9-a827-469de153da63', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cf04e8cf-6f5c-4acb-82cc-fecd724b0491', 'enforce_multipath': True} {{(pid=87123) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 08 01:21:20 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c" returned: 1 in 0.853s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:21:20 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Downloaded image bc444aca-2a0b-4228-a1b9-ae952a7d34e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/bc444aca-2a0b-4228-a1b9-ae952a7d34e6', 'metadata': {}}])) to volume b6a10425-4f51-4da1-8e52-738f15b0cd5c successfully. {{(pid=87123) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:21:20 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Temporary image bc444aca-2a0b-4228-a1b9-ae952a7d34e6 for user 975fb5d379104db49cf1453caa3746c2 is deleted. {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:21:20 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Marking volume b6a10425-4f51-4da1-8e52-738f15b0cd5c as bootable. {{(pid=87123) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:21:20 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Copying metadata from image bc444aca-2a0b-4228-a1b9-ae952a7d34e6 to b6a10425-4f51-4da1-8e52-738f15b0cd5c. {{(pid=87123) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:21:20 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Creating volume glance metadata for volume b6a10425-4f51-4da1-8e52-738f15b0cd5c backed by image bc444aca-2a0b-4228-a1b9-ae952a7d34e6 with: {'image_id': 'bc444aca-2a0b-4228-a1b9-ae952a7d34e6', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '34cfe05cde1951d912f77731af13d3c3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87123) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:21:20 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-41b0ac7c-623c-4819-8dee-ae60f04835cc req-786ecff0-8d11-4918-9127-be230614dac2 tempest-TestStampPattern-2032631778 None] attachment_update completed successfully. Jul 08 01:21:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (238fd944-8304-4129-b0f1-2666bc4910b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c', 'volume_size': 1, 'image_id': 'bc444aca-2a0b-4228-a1b9-ae952a7d34e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/bc444aca-2a0b-4228-a1b9-ae952a7d34e6', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '34cfe05cde1951d912f77731af13d3c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2c26804bbcf2466c95484f7cf19f7c63', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '658a9129620bf29df2fe5899270e03e80293dd17922351e959fb45cc7b7605c822b93abeaf5f40542129c4639979f8790aac0fb2576d73f990cfc6f0bdd32077', 'id': 'bc444aca-2a0b-4228-a1b9-ae952a7d34e6', 'created_at': datetime.datetime(2026, 7, 7, 23, 21, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 21, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/bc444aca-2a0b-4228-a1b9-ae952a7d34e6/file', 'properties': {}}, 'image_service': }' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc72a1db-a4fe-40e7-a9b6-86979d39d6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:20 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Volume volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c (b6a10425-4f51-4da1-8e52-738f15b0cd5c): created successfully Jul 08 01:21:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc72a1db-a4fe-40e7-a9b6-86979d39d6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Flow 'volume_create_manager' (95972bb9-9a92-4f36-8cda-d16c23ce3fdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:21:20 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f5a0d5e2-9dbd-4ef9-86be-fe875c502fde tempest-VolumeImageDependencyTests-1074346621 None] Created volume successfully. Jul 08 01:21:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] Acquiring lock "cinder-b6a10425-4f51-4da1-8e52-738f15b0cd5c-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] Lock "cinder-b6a10425-4f51-4da1-8e52-738f15b0cd5c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] Acquiring lock "cinder-quobyte-b6a10425-4f51-4da1-8e52-738f15b0cd5c" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] Lock "cinder-quobyte-b6a10425-4f51-4da1-8e52-738f15b0cd5c" acquired by "delete_volume" :: waited 0.033s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:20 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c2fb96-433f-4fb9-b509-d89271362062]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:21 devstack sudo[103934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c Jul 08 01:21:21 devstack sudo[103934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:21 devstack sudo[103934]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c" returned: 0 in 0.855s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:21 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c Jul 08 01:21:21 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:22 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c" returned: 1 in 0.907s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:21:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:22 devstack sudo[104331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c Jul 08 01:21:22 devstack sudo[104331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:23 devstack sudo[104331]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b6a10425-4f51-4da1-8e52-738f15b0cd5c" returned: 0 in 0.742s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] Lock "cinder-quobyte-b6a10425-4f51-4da1-8e52-738f15b0cd5c" released by "delete_volume" :: held 2.587s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:23 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] Created reservations ['4a5d3f5a-28f6-4319-a07d-37254c7fd3e0', '17a14979-59fd-4421-9a5e-fcd825e63edf', '567b8089-f142-4ce4-afd2-d3c78be657c8', '23c77533-530e-45a6-9e40-35a7d69631d5'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:21:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:23 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:21:23 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:24 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.766s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:24 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:21:24 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] Deleted volume successfully. Jul 08 01:21:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f157f03e-691b-4ea5-a973-211b8022dda3 tempest-VolumeImageDependencyTests-1074346621 None] Lock "cinder-b6a10425-4f51-4da1-8e52-738f15b0cd5c-delete_volume" released by "delete_volume" :: held 3.597s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:27 devstack cinder-volume[87123]: INFO cinder.volume.manager [req-2e87e917-5f5f-41ab-8d50-49b2751d3ca6 req-b59ef0b6-557b-4f01-b0de-34e1f52f2878 tempest-TestStampPattern-2032631778 None] Terminate volume connection completed successfully. Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [req-2e87e917-5f5f-41ab-8d50-49b2751d3ca6 req-b59ef0b6-557b-4f01-b0de-34e1f52f2878 tempest-TestStampPattern-2032631778 None] Deleting attachment cf04e8cf-6f5c-4acb-82cc-fecd724b0491. {{(pid=87123) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Flow 'volume_create_manager' (c1c5909d-ea5b-4896-816f-66935551237f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62bc635-8fa3-46ca-a623-cdc7f86de149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f62bc635-8fa3-46ca-a623-cdc7f86de149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f396a7-5b4d-4052-9479-10fd5f5a3797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='270d63bba81f426ea6b5dc3aa42c58c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:21:28Z,use_quota=True,user_id='c11de4838bc84647aabbaab6a910c053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5df4ff9-31a8-480c-a42f-fe5e1b7c679f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5df4ff9-31a8-480c-a42f-fe5e1b7c679f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b9f771-53f7-4f63-8f2e-18c2154a72ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b9f771-53f7-4f63-8f2e-18c2154a72ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04f396a7-5b4d-4052-9479-10fd5f5a3797', 'volume_name': 'volume-04f396a7-5b4d-4052-9479-10fd5f5a3797', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eddcafe4-2d10-44be-900b-6b66a330a407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eddcafe4-2d10-44be-900b-6b66a330a407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c8fece-c3a8-403d-af22-1e272df6cfec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:27 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Volume 04f396a7-5b4d-4052-9479-10fd5f5a3797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04f396a7-5b4d-4052-9479-10fd5f5a3797', 'volume_size': 1} Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04f396a7-5b4d-4052-9479-10fd5f5a3797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='270d63bba81f426ea6b5dc3aa42c58c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:21:28Z,use_quota=True,user_id='c11de4838bc84647aabbaab6a910c053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Creating volume 04f396a7-5b4d-4052-9479-10fd5f5a3797 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:21:27 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:21:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04f396a7-5b4d-4052-9479-10fd5f5a3797 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:27 devstack sudo[104380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04f396a7-5b4d-4052-9479-10fd5f5a3797 1073741824 Jul 08 01:21:27 devstack sudo[104380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:28 devstack sudo[104380]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04f396a7-5b4d-4052-9479-10fd5f5a3797 1073741824" returned: 0 in 1.013s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04f396a7-5b4d-4052-9479-10fd5f5a3797 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:29 devstack sudo[104386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04f396a7-5b4d-4052-9479-10fd5f5a3797 Jul 08 01:21:29 devstack sudo[104386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:29 devstack sudo[104386]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04f396a7-5b4d-4052-9479-10fd5f5a3797" returned: 0 in 0.775s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:29 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:21:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:29 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58c8fece-c3a8-403d-af22-1e272df6cfec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04f396a7-5b4d-4052-9479-10fd5f5a3797', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:29 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd58f242-8e7c-4c75-932d-1222f05ee32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:29 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Volume volume-04f396a7-5b4d-4052-9479-10fd5f5a3797 (04f396a7-5b4d-4052-9479-10fd5f5a3797): created successfully Jul 08 01:21:29 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd58f242-8e7c-4c75-932d-1222f05ee32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:29 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Flow 'volume_create_manager' (c1c5909d-ea5b-4896-816f-66935551237f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:21:29 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-587e570a-98ea-40f5-8887-5e69ea6980bf tempest-CinderUnicodeTest-32617595 None] Created volume successfully. Jul 08 01:21:31 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:21:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Flow 'volume_create_manager' (d42cea3f-eed8-4ecb-86b6-7119bce5c487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:21:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae6fec79-0ad4-47fb-bc96-dcada5ff3865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae6fec79-0ad4-47fb-bc96-dcada5ff3865) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:21:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-353965491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3912d248-2705-4b8b-95cb-1671ff29a638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='270d63bba81f426ea6b5dc3aa42c58c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:21:32Z,use_quota=True,user_id='c11de4838bc84647aabbaab6a910c053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d6236f-1e93-42ff-9fac-f9113467900b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43d6236f-1e93-42ff-9fac-f9113467900b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565e1b5a-512f-416c-ad03-ad780ff2ccbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (565e1b5a-512f-416c-ad03-ad780ff2ccbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3912d248-2705-4b8b-95cb-1671ff29a638', 'volume_name': 'volume-3912d248-2705-4b8b-95cb-1671ff29a638', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0aa79c1-4dc2-43e3-a242-246ab1512860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0aa79c1-4dc2-43e3-a242-246ab1512860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9aab9d7-1380-4218-83d6-397c351a2d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:31 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Volume 3912d248-2705-4b8b-95cb-1671ff29a638: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3912d248-2705-4b8b-95cb-1671ff29a638', 'volume_size': 1} Jul 08 01:21:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:21:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-353965491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3912d248-2705-4b8b-95cb-1671ff29a638,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='270d63bba81f426ea6b5dc3aa42c58c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:21:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:21:32Z,use_quota=True,user_id='c11de4838bc84647aabbaab6a910c053',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:21:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Creating volume 3912d248-2705-4b8b-95cb-1671ff29a638 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:21:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:21:31 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:21:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:31 devstack sudo[104393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638 1073741824 Jul 08 01:21:31 devstack sudo[104393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:32 devstack sudo[104393]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638 1073741824" returned: 0 in 1.106s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:32 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638 Jul 08 01:21:32 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:33 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638" returned: 0 in 0.794s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] <== create_volume: return (1971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:21:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.975s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9aab9d7-1380-4218-83d6-397c351a2d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3912d248-2705-4b8b-95cb-1671ff29a638', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4666818d-7020-48b0-bcdf-9e7928b85813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:21:33 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Volume volume-3912d248-2705-4b8b-95cb-1671ff29a638 (3912d248-2705-4b8b-95cb-1671ff29a638): created successfully Jul 08 01:21:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4666818d-7020-48b0-bcdf-9e7928b85813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:21:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Flow 'volume_create_manager' (d42cea3f-eed8-4ecb-86b6-7119bce5c487) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:21:33 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b45489d9-cb17-410f-9b14-4476a2e72865 tempest-CinderUnicodeTest-32617595 None] Created volume successfully. Jul 08 01:21:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-225b18a8-a66b-4965-9d02-48e65cf81699 tempest-CinderUnicodeTest-32617595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-225b18a8-a66b-4965-9d02-48e65cf81699 tempest-CinderUnicodeTest-32617595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-225b18a8-a66b-4965-9d02-48e65cf81699 tempest-CinderUnicodeTest-32617595 None] Creating offline snapshot 70802f5a-e2c3-4d68-91e3-cc594523545c of volume 3912d248-2705-4b8b-95cb-1671ff29a638 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:21:35 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0019bb-48b9-4858-9dec-411d9226fea8]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-225b18a8-a66b-4965-9d02-48e65cf81699 tempest-CinderUnicodeTest-32617595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:35 devstack sudo[104429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638 Jul 08 01:21:35 devstack sudo[104429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:35 devstack sudo[104429]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-225b18a8-a66b-4965-9d02-48e65cf81699 tempest-CinderUnicodeTest-32617595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638" returned: 0 in 0.831s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-225b18a8-a66b-4965-9d02-48e65cf81699 tempest-CinderUnicodeTest-32617595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.70802f5a-e2c3-4d68-91e3-cc594523545c 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:36 devstack sudo[104434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.70802f5a-e2c3-4d68-91e3-cc594523545c 1G Jul 08 01:21:36 devstack sudo[104434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:36 devstack sudo[104434]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-225b18a8-a66b-4965-9d02-48e65cf81699 tempest-CinderUnicodeTest-32617595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.70802f5a-e2c3-4d68-91e3-cc594523545c 1G" returned: 0 in 0.868s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-225b18a8-a66b-4965-9d02-48e65cf81699 tempest-CinderUnicodeTest-32617595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3912d248-2705-4b8b-95cb-1671ff29a638 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.70802f5a-e2c3-4d68-91e3-cc594523545c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:36 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3912d248-2705-4b8b-95cb-1671ff29a638 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.70802f5a-e2c3-4d68-91e3-cc594523545c Jul 08 01:21:36 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:37 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-acaf58df-9730-4e32-a43b-6ea3d1a0a44a tempest-TestStampPattern-2032631778 None] Acquiring lock "cinder-9ac7f2cb-a4d1-41e9-a827-469de153da63-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:37 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-acaf58df-9730-4e32-a43b-6ea3d1a0a44a tempest-TestStampPattern-2032631778 None] Lock "cinder-9ac7f2cb-a4d1-41e9-a827-469de153da63-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:37 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-acaf58df-9730-4e32-a43b-6ea3d1a0a44a tempest-TestStampPattern-2032631778 None] Acquiring lock "cinder-quobyte-9ac7f2cb-a4d1-41e9-a827-469de153da63" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:37 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-acaf58df-9730-4e32-a43b-6ea3d1a0a44a tempest-TestStampPattern-2032631778 None] Lock "cinder-quobyte-9ac7f2cb-a4d1-41e9-a827-469de153da63" acquired by "delete_volume" :: waited 0.016s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:37 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c22c6b1-1155-4b78-9412-035a6c3449f7]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-acaf58df-9730-4e32-a43b-6ea3d1a0a44a tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9ac7f2cb-a4d1-41e9-a827-469de153da63 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:37 devstack sudo[104441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9ac7f2cb-a4d1-41e9-a827-469de153da63 Jul 08 01:21:37 devstack sudo[104441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:37 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-225b18a8-a66b-4965-9d02-48e65cf81699 tempest-CinderUnicodeTest-32617595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3912d248-2705-4b8b-95cb-1671ff29a638 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.70802f5a-e2c3-4d68-91e3-cc594523545c" returned: 0 in 0.783s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:37 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-225b18a8-a66b-4965-9d02-48e65cf81699 tempest-CinderUnicodeTest-32617595 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.70802f5a-e2c3-4d68-91e3-cc594523545c is being set with open permissions: ugo+rw Jul 08 01:21:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-225b18a8-a66b-4965-9d02-48e65cf81699 tempest-CinderUnicodeTest-32617595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.70802f5a-e2c3-4d68-91e3-cc594523545c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:37 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.70802f5a-e2c3-4d68-91e3-cc594523545c Jul 08 01:21:37 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:38 devstack sudo[104441]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-acaf58df-9730-4e32-a43b-6ea3d1a0a44a tempest-TestStampPattern-2032631778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9ac7f2cb-a4d1-41e9-a827-469de153da63" returned: 0 in 0.975s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-acaf58df-9730-4e32-a43b-6ea3d1a0a44a tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9ac7f2cb-a4d1-41e9-a827-469de153da63 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:38 devstack sudo[104452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9ac7f2cb-a4d1-41e9-a827-469de153da63 Jul 08 01:21:38 devstack sudo[104452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:38 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-225b18a8-a66b-4965-9d02-48e65cf81699 tempest-CinderUnicodeTest-32617595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.70802f5a-e2c3-4d68-91e3-cc594523545c" returned: 0 in 0.679s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-225b18a8-a66b-4965-9d02-48e65cf81699 tempest-CinderUnicodeTest-32617595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:38 devstack sudo[104454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.info Jul 08 01:21:38 devstack sudo[104454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:39 devstack sudo[104452]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-acaf58df-9730-4e32-a43b-6ea3d1a0a44a tempest-TestStampPattern-2032631778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9ac7f2cb-a4d1-41e9-a827-469de153da63" returned: 0 in 0.802s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-acaf58df-9730-4e32-a43b-6ea3d1a0a44a tempest-TestStampPattern-2032631778 None] Lock "cinder-quobyte-9ac7f2cb-a4d1-41e9-a827-469de153da63" released by "delete_volume" :: held 1.826s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:39 devstack sudo[104454]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-225b18a8-a66b-4965-9d02-48e65cf81699 tempest-CinderUnicodeTest-32617595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.info" returned: 0 in 0.695s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:39 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-225b18a8-a66b-4965-9d02-48e65cf81699 tempest-CinderUnicodeTest-32617595 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.info is being set with open permissions: ugo+rw Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-225b18a8-a66b-4965-9d02-48e65cf81699 tempest-CinderUnicodeTest-32617595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:39 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.info Jul 08 01:21:39 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-acaf58df-9730-4e32-a43b-6ea3d1a0a44a tempest-TestStampPattern-2032631778 None] Created reservations ['3f3cb07e-97ed-4180-9033-29a993dbc7ae', 'c88b1810-a305-44f9-a70a-18cb1f9b0f04', 'bcc687e2-169d-45a2-9ac3-ae3d3725bec4', '858584e3-b71f-4112-bae1-0166a1ab9303'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-acaf58df-9730-4e32-a43b-6ea3d1a0a44a tempest-TestStampPattern-2032631778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-acaf58df-9730-4e32-a43b-6ea3d1a0a44a tempest-TestStampPattern-2032631778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-acaf58df-9730-4e32-a43b-6ea3d1a0a44a tempest-TestStampPattern-2032631778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-acaf58df-9730-4e32-a43b-6ea3d1a0a44a tempest-TestStampPattern-2032631778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-acaf58df-9730-4e32-a43b-6ea3d1a0a44a tempest-TestStampPattern-2032631778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-acaf58df-9730-4e32-a43b-6ea3d1a0a44a tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:39 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:21:39 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ef9bbd05-b7dd-4140-8726-2410a2383dae tempest-TestStampPattern-2032631778 None] Acquiring lock "cinder-ea2e8b51-c588-45db-b921-236155c09031-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ef9bbd05-b7dd-4140-8726-2410a2383dae tempest-TestStampPattern-2032631778 None] Lock "cinder-ea2e8b51-c588-45db-b921-236155c09031-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ef9bbd05-b7dd-4140-8726-2410a2383dae tempest-TestStampPattern-2032631778 None] Acquiring lock "cinder-quobyte-1e185660-2bc7-496c-b883-ddfeeef7235a" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ef9bbd05-b7dd-4140-8726-2410a2383dae tempest-TestStampPattern-2032631778 None] Lock "cinder-quobyte-1e185660-2bc7-496c-b883-ddfeeef7235a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ef9bbd05-b7dd-4140-8726-2410a2383dae tempest-TestStampPattern-2032631778 None] Acquiring lock "cinder-quobyte-ea2e8b51-c588-45db-b921-236155c09031" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:39 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ef9bbd05-b7dd-4140-8726-2410a2383dae tempest-TestStampPattern-2032631778 None] Lock "cinder-quobyte-ea2e8b51-c588-45db-b921-236155c09031" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-ef9bbd05-b7dd-4140-8726-2410a2383dae tempest-TestStampPattern-2032631778 None] Deleting offline snapshot ea2e8b51-c588-45db-b921-236155c09031 of volume 1e185660-2bc7-496c-b883-ddfeeef7235a {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-ef9bbd05-b7dd-4140-8726-2410a2383dae tempest-TestStampPattern-2032631778 None] snapshot_file for this snap is: volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-225b18a8-a66b-4965-9d02-48e65cf81699 tempest-CinderUnicodeTest-32617595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.info" returned: 0 in 0.750s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-225b18a8-a66b-4965-9d02-48e65cf81699 tempest-CinderUnicodeTest-32617595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.728s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99508bd-af0a-4d04-8a4d-8851aabc1e23]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ef9bbd05-b7dd-4140-8726-2410a2383dae tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:39 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-225b18a8-a66b-4965-9d02-48e65cf81699 tempest-CinderUnicodeTest-32617595 None] Create snapshot completed successfully Jul 08 01:21:39 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-acaf58df-9730-4e32-a43b-6ea3d1a0a44a tempest-TestStampPattern-2032631778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.770s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:39 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-acaf58df-9730-4e32-a43b-6ea3d1a0a44a tempest-TestStampPattern-2032631778 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:21:39 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-acaf58df-9730-4e32-a43b-6ea3d1a0a44a tempest-TestStampPattern-2032631778 None] Deleted volume successfully. Jul 08 01:21:39 devstack sudo[104465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031 Jul 08 01:21:39 devstack sudo[104465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-acaf58df-9730-4e32-a43b-6ea3d1a0a44a tempest-TestStampPattern-2032631778 None] Lock "cinder-9ac7f2cb-a4d1-41e9-a827-469de153da63-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6dc65394-5b85-4b25-98d9-a8b0b10e21fd tempest-CinderUnicodeTest-32617595 None] Acquiring lock "cinder-70802f5a-e2c3-4d68-91e3-cc594523545c-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6dc65394-5b85-4b25-98d9-a8b0b10e21fd tempest-CinderUnicodeTest-32617595 None] Lock "cinder-70802f5a-e2c3-4d68-91e3-cc594523545c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6dc65394-5b85-4b25-98d9-a8b0b10e21fd tempest-CinderUnicodeTest-32617595 None] Acquiring lock "cinder-quobyte-3912d248-2705-4b8b-95cb-1671ff29a638" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6dc65394-5b85-4b25-98d9-a8b0b10e21fd tempest-CinderUnicodeTest-32617595 None] Lock "cinder-quobyte-3912d248-2705-4b8b-95cb-1671ff29a638" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6dc65394-5b85-4b25-98d9-a8b0b10e21fd tempest-CinderUnicodeTest-32617595 None] Acquiring lock "cinder-quobyte-70802f5a-e2c3-4d68-91e3-cc594523545c" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6dc65394-5b85-4b25-98d9-a8b0b10e21fd tempest-CinderUnicodeTest-32617595 None] Lock "cinder-quobyte-70802f5a-e2c3-4d68-91e3-cc594523545c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-6dc65394-5b85-4b25-98d9-a8b0b10e21fd tempest-CinderUnicodeTest-32617595 None] Deleting offline snapshot 70802f5a-e2c3-4d68-91e3-cc594523545c of volume 3912d248-2705-4b8b-95cb-1671ff29a638 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:21:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-6dc65394-5b85-4b25-98d9-a8b0b10e21fd tempest-CinderUnicodeTest-32617595 None] snapshot_file for this snap is: volume-3912d248-2705-4b8b-95cb-1671ff29a638.70802f5a-e2c3-4d68-91e3-cc594523545c {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:21:40 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[460b277f-b81a-4416-9f5a-8b7394f7979e]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6dc65394-5b85-4b25-98d9-a8b0b10e21fd tempest-CinderUnicodeTest-32617595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.70802f5a-e2c3-4d68-91e3-cc594523545c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:40 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.70802f5a-e2c3-4d68-91e3-cc594523545c Jul 08 01:21:40 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:40 devstack sudo[104465]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ef9bbd05-b7dd-4140-8726-2410a2383dae tempest-TestStampPattern-2032631778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031" returned: 0 in 0.921s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-ef9bbd05-b7dd-4140-8726-2410a2383dae tempest-TestStampPattern-2032631778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e185660-2bc7-496c-b883-ddfeeef7235a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:21:40 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48e1d50-2ffe-4263-b4d4-f8e7bcac2240]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ef9bbd05-b7dd-4140-8726-2410a2383dae tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:40 devstack sudo[104473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a Jul 08 01:21:40 devstack sudo[104473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:41 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6dc65394-5b85-4b25-98d9-a8b0b10e21fd tempest-CinderUnicodeTest-32617595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.70802f5a-e2c3-4d68-91e3-cc594523545c" returned: 0 in 0.866s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:41 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-6dc65394-5b85-4b25-98d9-a8b0b10e21fd tempest-CinderUnicodeTest-32617595 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3912d248-2705-4b8b-95cb-1671ff29a638(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:21:41 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[310e8ea0-a289-4eb7-a5cf-2e48edc13c40]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6dc65394-5b85-4b25-98d9-a8b0b10e21fd tempest-CinderUnicodeTest-32617595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:41 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638 Jul 08 01:21:41 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:41 devstack sudo[104473]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ef9bbd05-b7dd-4140-8726-2410a2383dae tempest-TestStampPattern-2032631778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a" returned: 0 in 0.886s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ef9bbd05-b7dd-4140-8726-2410a2383dae tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:41 devstack sudo[104483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031 Jul 08 01:21:41 devstack sudo[104483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:42 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6dc65394-5b85-4b25-98d9-a8b0b10e21fd tempest-CinderUnicodeTest-32617595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638" returned: 0 in 0.866s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6dc65394-5b85-4b25-98d9-a8b0b10e21fd tempest-CinderUnicodeTest-32617595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.70802f5a-e2c3-4d68-91e3-cc594523545c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:42 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.70802f5a-e2c3-4d68-91e3-cc594523545c Jul 08 01:21:42 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:42 devstack sudo[104483]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ef9bbd05-b7dd-4140-8726-2410a2383dae tempest-TestStampPattern-2032631778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031" returned: 0 in 0.781s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ef9bbd05-b7dd-4140-8726-2410a2383dae tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:42 devstack sudo[104493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031 Jul 08 01:21:42 devstack sudo[104493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:43 devstack sudo[104493]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ef9bbd05-b7dd-4140-8726-2410a2383dae tempest-TestStampPattern-2032631778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a.ea2e8b51-c588-45db-b921-236155c09031" returned: 0 in 0.664s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:43 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6dc65394-5b85-4b25-98d9-a8b0b10e21fd tempest-CinderUnicodeTest-32617595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.70802f5a-e2c3-4d68-91e3-cc594523545c" returned: 0 in 0.923s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6dc65394-5b85-4b25-98d9-a8b0b10e21fd tempest-CinderUnicodeTest-32617595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.70802f5a-e2c3-4d68-91e3-cc594523545c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ef9bbd05-b7dd-4140-8726-2410a2383dae tempest-TestStampPattern-2032631778 None] Lock "cinder-quobyte-ea2e8b51-c588-45db-b921-236155c09031" released by "_delete_snapshot" :: held 3.421s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ef9bbd05-b7dd-4140-8726-2410a2383dae tempest-TestStampPattern-2032631778 None] Lock "cinder-quobyte-1e185660-2bc7-496c-b883-ddfeeef7235a" released by "delete_snapshot" :: held 3.449s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:43 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.70802f5a-e2c3-4d68-91e3-cc594523545c Jul 08 01:21:43 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:43 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-ef9bbd05-b7dd-4140-8726-2410a2383dae tempest-TestStampPattern-2032631778 None] Created reservations ['86536499-a7d0-4a23-bf2a-488b9bb7478a', 'e8d7b68c-cd64-468a-b2ad-f0b67b761ddc', '3171aa40-8606-42b5-9218-ed7d697b585d', 'c79da895-49e1-4bff-a848-c083508cc2b3'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:21:43 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-ef9bbd05-b7dd-4140-8726-2410a2383dae tempest-TestStampPattern-2032631778 None] Delete snapshot completed successfully. Jul 08 01:21:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ef9bbd05-b7dd-4140-8726-2410a2383dae tempest-TestStampPattern-2032631778 None] Lock "cinder-ea2e8b51-c588-45db-b921-236155c09031-delete_snapshot" released by "delete_snapshot" :: held 3.611s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:43 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6dc65394-5b85-4b25-98d9-a8b0b10e21fd tempest-CinderUnicodeTest-32617595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638.70802f5a-e2c3-4d68-91e3-cc594523545c" returned: 0 in 0.689s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6dc65394-5b85-4b25-98d9-a8b0b10e21fd tempest-CinderUnicodeTest-32617595 None] Lock "cinder-quobyte-70802f5a-e2c3-4d68-91e3-cc594523545c" released by "_delete_snapshot" :: held 3.459s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6dc65394-5b85-4b25-98d9-a8b0b10e21fd tempest-CinderUnicodeTest-32617595 None] Lock "cinder-quobyte-3912d248-2705-4b8b-95cb-1671ff29a638" released by "delete_snapshot" :: held 3.481s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:44 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-6dc65394-5b85-4b25-98d9-a8b0b10e21fd tempest-CinderUnicodeTest-32617595 None] Created reservations ['8fbf9f65-a9ad-46b6-a1e7-d371c9bb46d5', 'bccc72eb-198d-47c9-a746-beea4814f555', 'fbbbca0d-1e69-4da9-880c-8dad09483c6d', '27411f85-fa23-4cfa-a67d-7f90b824e075'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:21:44 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-6dc65394-5b85-4b25-98d9-a8b0b10e21fd tempest-CinderUnicodeTest-32617595 None] Delete snapshot completed successfully. Jul 08 01:21:44 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6dc65394-5b85-4b25-98d9-a8b0b10e21fd tempest-CinderUnicodeTest-32617595 None] Lock "cinder-70802f5a-e2c3-4d68-91e3-cc594523545c-delete_snapshot" released by "delete_snapshot" :: held 3.642s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:44 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-83423515-bee3-4cae-9532-8d133f108886 tempest-CinderUnicodeTest-32617595 None] Acquiring lock "cinder-3912d248-2705-4b8b-95cb-1671ff29a638-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:44 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-83423515-bee3-4cae-9532-8d133f108886 tempest-CinderUnicodeTest-32617595 None] Lock "cinder-3912d248-2705-4b8b-95cb-1671ff29a638-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:44 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-83423515-bee3-4cae-9532-8d133f108886 tempest-CinderUnicodeTest-32617595 None] Acquiring lock "cinder-quobyte-3912d248-2705-4b8b-95cb-1671ff29a638" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:44 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-83423515-bee3-4cae-9532-8d133f108886 tempest-CinderUnicodeTest-32617595 None] Lock "cinder-quobyte-3912d248-2705-4b8b-95cb-1671ff29a638" acquired by "delete_volume" :: waited 0.015s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:44 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e52e37-5d42-45ea-b25e-eccb6d1aac94]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-83423515-bee3-4cae-9532-8d133f108886 tempest-CinderUnicodeTest-32617595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:21:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:44 devstack sudo[104507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:21:44 devstack sudo[104507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:45 devstack sudo[104506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638 Jul 08 01:21:45 devstack sudo[104506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:45 devstack sudo[104507]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.765s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:45 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:21:45 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:21:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 28 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:21:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:21:45 devstack sudo[104506]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-83423515-bee3-4cae-9532-8d133f108886 tempest-CinderUnicodeTest-32617595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638" returned: 0 in 0.927s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-83423515-bee3-4cae-9532-8d133f108886 tempest-CinderUnicodeTest-32617595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:45 devstack sudo[104515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638 Jul 08 01:21:45 devstack sudo[104515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:46 devstack sudo[104515]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-83423515-bee3-4cae-9532-8d133f108886 tempest-CinderUnicodeTest-32617595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3912d248-2705-4b8b-95cb-1671ff29a638" returned: 0 in 0.700s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-83423515-bee3-4cae-9532-8d133f108886 tempest-CinderUnicodeTest-32617595 None] Lock "cinder-quobyte-3912d248-2705-4b8b-95cb-1671ff29a638" released by "delete_volume" :: held 1.708s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:46 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-83423515-bee3-4cae-9532-8d133f108886 tempest-CinderUnicodeTest-32617595 None] Created reservations ['ed2b04fe-e4a8-4343-8c17-ce7f4e291f81', 'fe063fa7-5974-4442-8fa6-a6bf273d0ef1', 'a5ba23d4-6d6a-48ae-b868-f7d991d06989', '5f9da640-cbd5-4510-9f94-27b8be83bb00'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:21:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-83423515-bee3-4cae-9532-8d133f108886 tempest-CinderUnicodeTest-32617595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-83423515-bee3-4cae-9532-8d133f108886 tempest-CinderUnicodeTest-32617595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-83423515-bee3-4cae-9532-8d133f108886 tempest-CinderUnicodeTest-32617595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-83423515-bee3-4cae-9532-8d133f108886 tempest-CinderUnicodeTest-32617595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-83423515-bee3-4cae-9532-8d133f108886 tempest-CinderUnicodeTest-32617595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-83423515-bee3-4cae-9532-8d133f108886 tempest-CinderUnicodeTest-32617595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:46 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:21:46 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-51eb182d-b5f5-410f-80ee-658b74678c91 tempest-CinderUnicodeTest-32617595 None] Acquiring lock "cinder-04f396a7-5b4d-4052-9479-10fd5f5a3797-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-51eb182d-b5f5-410f-80ee-658b74678c91 tempest-CinderUnicodeTest-32617595 None] Lock "cinder-04f396a7-5b4d-4052-9479-10fd5f5a3797-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-51eb182d-b5f5-410f-80ee-658b74678c91 tempest-CinderUnicodeTest-32617595 None] Acquiring lock "cinder-quobyte-04f396a7-5b4d-4052-9479-10fd5f5a3797" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-51eb182d-b5f5-410f-80ee-658b74678c91 tempest-CinderUnicodeTest-32617595 None] Lock "cinder-quobyte-04f396a7-5b4d-4052-9479-10fd5f5a3797" acquired by "delete_volume" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:47 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e07ff59-9c2f-4953-b6c2-cfa298c7d23f]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-51eb182d-b5f5-410f-80ee-658b74678c91 tempest-CinderUnicodeTest-32617595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04f396a7-5b4d-4052-9479-10fd5f5a3797 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:47 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04f396a7-5b4d-4052-9479-10fd5f5a3797 Jul 08 01:21:47 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:47 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-83423515-bee3-4cae-9532-8d133f108886 tempest-CinderUnicodeTest-32617595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.876s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:47 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-83423515-bee3-4cae-9532-8d133f108886 tempest-CinderUnicodeTest-32617595 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:21:47 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-83423515-bee3-4cae-9532-8d133f108886 tempest-CinderUnicodeTest-32617595 None] Deleted volume successfully. Jul 08 01:21:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-83423515-bee3-4cae-9532-8d133f108886 tempest-CinderUnicodeTest-32617595 None] Lock "cinder-3912d248-2705-4b8b-95cb-1671ff29a638-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:48 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-51eb182d-b5f5-410f-80ee-658b74678c91 tempest-CinderUnicodeTest-32617595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04f396a7-5b4d-4052-9479-10fd5f5a3797" returned: 0 in 0.890s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-51eb182d-b5f5-410f-80ee-658b74678c91 tempest-CinderUnicodeTest-32617595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04f396a7-5b4d-4052-9479-10fd5f5a3797 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:48 devstack sudo[104550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04f396a7-5b4d-4052-9479-10fd5f5a3797 Jul 08 01:21:48 devstack sudo[104550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:48 devstack sudo[104550]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-51eb182d-b5f5-410f-80ee-658b74678c91 tempest-CinderUnicodeTest-32617595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-04f396a7-5b4d-4052-9479-10fd5f5a3797" returned: 0 in 0.653s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:48 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-51eb182d-b5f5-410f-80ee-658b74678c91 tempest-CinderUnicodeTest-32617595 None] Lock "cinder-quobyte-04f396a7-5b4d-4052-9479-10fd5f5a3797" released by "delete_volume" :: held 1.605s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:48 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-51eb182d-b5f5-410f-80ee-658b74678c91 tempest-CinderUnicodeTest-32617595 None] Created reservations ['29660dd5-2af6-430f-8629-bc10bf7a2907', 'ba04b48b-b6d5-4879-bbf9-e31ad56dd053', 'b469627d-7bd6-4889-9e53-ece72b57304b', '520fe066-dc82-4043-b15a-a8630547a9dd'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:21:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-51eb182d-b5f5-410f-80ee-658b74678c91 tempest-CinderUnicodeTest-32617595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-51eb182d-b5f5-410f-80ee-658b74678c91 tempest-CinderUnicodeTest-32617595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-51eb182d-b5f5-410f-80ee-658b74678c91 tempest-CinderUnicodeTest-32617595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-51eb182d-b5f5-410f-80ee-658b74678c91 tempest-CinderUnicodeTest-32617595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-51eb182d-b5f5-410f-80ee-658b74678c91 tempest-CinderUnicodeTest-32617595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-51eb182d-b5f5-410f-80ee-658b74678c91 tempest-CinderUnicodeTest-32617595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:48 devstack sudo[104553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:21:48 devstack sudo[104553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:49 devstack sudo[104553]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-51eb182d-b5f5-410f-80ee-658b74678c91 tempest-CinderUnicodeTest-32617595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.735s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:49 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-51eb182d-b5f5-410f-80ee-658b74678c91 tempest-CinderUnicodeTest-32617595 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:21:49 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-51eb182d-b5f5-410f-80ee-658b74678c91 tempest-CinderUnicodeTest-32617595 None] Deleted volume successfully. Jul 08 01:21:49 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-51eb182d-b5f5-410f-80ee-658b74678c91 tempest-CinderUnicodeTest-32617595 None] Lock "cinder-04f396a7-5b4d-4052-9479-10fd5f5a3797-delete_volume" released by "delete_volume" :: held 2.557s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e73778de-3b99-4fd4-ab4a-33f613e081b9 tempest-TestStampPattern-2032631778 None] Acquiring lock "cinder-1e185660-2bc7-496c-b883-ddfeeef7235a-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e73778de-3b99-4fd4-ab4a-33f613e081b9 tempest-TestStampPattern-2032631778 None] Lock "cinder-1e185660-2bc7-496c-b883-ddfeeef7235a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e73778de-3b99-4fd4-ab4a-33f613e081b9 tempest-TestStampPattern-2032631778 None] Acquiring lock "cinder-quobyte-1e185660-2bc7-496c-b883-ddfeeef7235a" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:21:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e73778de-3b99-4fd4-ab4a-33f613e081b9 tempest-TestStampPattern-2032631778 None] Lock "cinder-quobyte-1e185660-2bc7-496c-b883-ddfeeef7235a" acquired by "delete_volume" :: waited 0.025s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:21:52 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[553f5a69-93e3-441b-8d48-42728e72b8dc]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:21:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e73778de-3b99-4fd4-ab4a-33f613e081b9 tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:52 devstack sudo[104557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a Jul 08 01:21:52 devstack sudo[104557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:53 devstack sudo[104557]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e73778de-3b99-4fd4-ab4a-33f613e081b9 tempest-TestStampPattern-2032631778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a" returned: 0 in 0.932s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e73778de-3b99-4fd4-ab4a-33f613e081b9 tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:53 devstack sudo[104563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a Jul 08 01:21:53 devstack sudo[104563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:54 devstack sudo[104563]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e73778de-3b99-4fd4-ab4a-33f613e081b9 tempest-TestStampPattern-2032631778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1e185660-2bc7-496c-b883-ddfeeef7235a" returned: 0 in 0.726s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e73778de-3b99-4fd4-ab4a-33f613e081b9 tempest-TestStampPattern-2032631778 None] Lock "cinder-quobyte-1e185660-2bc7-496c-b883-ddfeeef7235a" released by "delete_volume" :: held 1.748s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:21:54 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-e73778de-3b99-4fd4-ab4a-33f613e081b9 tempest-TestStampPattern-2032631778 None] Created reservations ['e57f7912-db1d-4c84-9eda-6bcd5024d368', 'b836464d-5d21-49a5-926a-417f7daefa4b', '22bf26f6-1b34-46e2-ae04-d2338048cd8b', '92ae49f3-819d-47ab-809a-ce2a19690f61'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:21:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e73778de-3b99-4fd4-ab4a-33f613e081b9 tempest-TestStampPattern-2032631778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:21:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e73778de-3b99-4fd4-ab4a-33f613e081b9 tempest-TestStampPattern-2032631778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:21:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e73778de-3b99-4fd4-ab4a-33f613e081b9 tempest-TestStampPattern-2032631778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:21:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e73778de-3b99-4fd4-ab4a-33f613e081b9 tempest-TestStampPattern-2032631778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:21:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e73778de-3b99-4fd4-ab4a-33f613e081b9 tempest-TestStampPattern-2032631778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:21:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e73778de-3b99-4fd4-ab4a-33f613e081b9 tempest-TestStampPattern-2032631778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:21:54 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:21:54 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:21:55 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Jul 08 01:21:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e73778de-3b99-4fd4-ab4a-33f613e081b9 tempest-TestStampPattern-2032631778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.808s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:21:55 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-e73778de-3b99-4fd4-ab4a-33f613e081b9 tempest-TestStampPattern-2032631778 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:21:55 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-e73778de-3b99-4fd4-ab4a-33f613e081b9 tempest-TestStampPattern-2032631778 None] Deleted volume successfully. Jul 08 01:21:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e73778de-3b99-4fd4-ab4a-33f613e081b9 tempest-TestStampPattern-2032631778 None] Lock "cinder-1e185660-2bc7-496c-b883-ddfeeef7235a-delete_volume" released by "delete_volume" :: held 2.831s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:04 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=54,cinder:UPDATE=68,cinder:INSERT=17,cinder:DELETE=2 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:22:05 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=61,cinder:UPDATE=61,cinder:INSERT=24,cinder:DELETE=7 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:22:11 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:22:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Flow 'volume_create_manager' (a34ec88f-ae64-4d4d-b181-38787f413712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e412b67c-d879-4eb3-af7c-7f1a0e4e44f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e412b67c-d879-4eb3-af7c-7f1a0e4e44f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1407381399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981cfcd7-b96e-430c-b04a-eee30c12368c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e9681e658d420d9a4ac07ab7a45b07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:12Z,use_quota=True,user_id='7a36d18a027a43499a0a309b00e798ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08519836-c46a-4599-b782-ff493e0f4fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08519836-c46a-4599-b782-ff493e0f4fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc7278c-9fc5-4685-b6bb-9b251f4a0489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cc7278c-9fc5-4685-b6bb-9b251f4a0489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '981cfcd7-b96e-430c-b04a-eee30c12368c', 'volume_name': 'volume-981cfcd7-b96e-430c-b04a-eee30c12368c', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14aac272-89c6-43fb-b26b-70fe6e1d85b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14aac272-89c6-43fb-b26b-70fe6e1d85b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa6fe5b-e7f3-4076-b3dd-325a97c445fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:11 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Volume 981cfcd7-b96e-430c-b04a-eee30c12368c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-981cfcd7-b96e-430c-b04a-eee30c12368c', 'volume_size': 1} Jul 08 01:22:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1407381399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=981cfcd7-b96e-430c-b04a-eee30c12368c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e9681e658d420d9a4ac07ab7a45b07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:12Z,use_quota=True,user_id='7a36d18a027a43499a0a309b00e798ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:22:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Creating volume 981cfcd7-b96e-430c-b04a-eee30c12368c {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:22:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:22:11 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:22:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-981cfcd7-b96e-430c-b04a-eee30c12368c 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:12 devstack sudo[104575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-981cfcd7-b96e-430c-b04a-eee30c12368c 1073741824 Jul 08 01:22:12 devstack sudo[104575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:12 devstack sudo[104575]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-981cfcd7-b96e-430c-b04a-eee30c12368c 1073741824" returned: 0 in 0.803s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-981cfcd7-b96e-430c-b04a-eee30c12368c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:12 devstack sudo[104580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-981cfcd7-b96e-430c-b04a-eee30c12368c Jul 08 01:22:12 devstack sudo[104580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:13 devstack sudo[104580]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-981cfcd7-b96e-430c-b04a-eee30c12368c" returned: 0 in 0.638s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:22:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.483s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fa6fe5b-e7f3-4076-b3dd-325a97c445fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-981cfcd7-b96e-430c-b04a-eee30c12368c', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a9c21d1-7b8e-469b-bfa8-65d0d462fe97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:13 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Volume volume-981cfcd7-b96e-430c-b04a-eee30c12368c (981cfcd7-b96e-430c-b04a-eee30c12368c): created successfully Jul 08 01:22:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a9c21d1-7b8e-469b-bfa8-65d0d462fe97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:13 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Flow 'volume_create_manager' (a34ec88f-ae64-4d4d-b181-38787f413712) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:13 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-68b96b57-0509-49a1-8ddc-e4114a12ec8b tempest-ProjectReaderTests-918728921 None] Created volume successfully. Jul 08 01:22:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-bb989511-7e90-4438-afa0-f5adc251edf4 tempest-ProjectReaderTests-918728921 None] Acquiring lock "cinder-981cfcd7-b96e-430c-b04a-eee30c12368c-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-bb989511-7e90-4438-afa0-f5adc251edf4 tempest-ProjectReaderTests-918728921 None] Lock "cinder-981cfcd7-b96e-430c-b04a-eee30c12368c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-bb989511-7e90-4438-afa0-f5adc251edf4 tempest-ProjectReaderTests-918728921 None] Acquiring lock "cinder-quobyte-981cfcd7-b96e-430c-b04a-eee30c12368c" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-bb989511-7e90-4438-afa0-f5adc251edf4 tempest-ProjectReaderTests-918728921 None] Lock "cinder-quobyte-981cfcd7-b96e-430c-b04a-eee30c12368c" acquired by "delete_volume" :: waited 0.013s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:14 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0a2170-8fb8-4e0e-b2a0-ffcb7577ac3b]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bb989511-7e90-4438-afa0-f5adc251edf4 tempest-ProjectReaderTests-918728921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-981cfcd7-b96e-430c-b04a-eee30c12368c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:14 devstack sudo[104583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-981cfcd7-b96e-430c-b04a-eee30c12368c Jul 08 01:22:14 devstack sudo[104583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:14 devstack sudo[104583]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bb989511-7e90-4438-afa0-f5adc251edf4 tempest-ProjectReaderTests-918728921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-981cfcd7-b96e-430c-b04a-eee30c12368c" returned: 0 in 0.740s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bb989511-7e90-4438-afa0-f5adc251edf4 tempest-ProjectReaderTests-918728921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-981cfcd7-b96e-430c-b04a-eee30c12368c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:14 devstack sudo[104588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-981cfcd7-b96e-430c-b04a-eee30c12368c Jul 08 01:22:14 devstack sudo[104588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:15 devstack sudo[104588]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bb989511-7e90-4438-afa0-f5adc251edf4 tempest-ProjectReaderTests-918728921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-981cfcd7-b96e-430c-b04a-eee30c12368c" returned: 0 in 0.696s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:15 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-bb989511-7e90-4438-afa0-f5adc251edf4 tempest-ProjectReaderTests-918728921 None] Lock "cinder-quobyte-981cfcd7-b96e-430c-b04a-eee30c12368c" released by "delete_volume" :: held 1.471s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:15 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-bb989511-7e90-4438-afa0-f5adc251edf4 tempest-ProjectReaderTests-918728921 None] Created reservations ['618b98d8-2a39-4f80-bd1f-237afbf05386', 'aa580ea1-385a-46d1-b43e-78363bc728dc', '51b663db-d995-48ec-86e8-56c024300782', 'ace0eb9e-d632-457a-ab3e-c4bd1d021958'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:22:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bb989511-7e90-4438-afa0-f5adc251edf4 tempest-ProjectReaderTests-918728921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bb989511-7e90-4438-afa0-f5adc251edf4 tempest-ProjectReaderTests-918728921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bb989511-7e90-4438-afa0-f5adc251edf4 tempest-ProjectReaderTests-918728921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bb989511-7e90-4438-afa0-f5adc251edf4 tempest-ProjectReaderTests-918728921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bb989511-7e90-4438-afa0-f5adc251edf4 tempest-ProjectReaderTests-918728921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bb989511-7e90-4438-afa0-f5adc251edf4 tempest-ProjectReaderTests-918728921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:15 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:22:15 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:16 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bb989511-7e90-4438-afa0-f5adc251edf4 tempest-ProjectReaderTests-918728921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.622s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-bb989511-7e90-4438-afa0-f5adc251edf4 tempest-ProjectReaderTests-918728921 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:22:16 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-bb989511-7e90-4438-afa0-f5adc251edf4 tempest-ProjectReaderTests-918728921 None] Deleted volume successfully. Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-bb989511-7e90-4438-afa0-f5adc251edf4 tempest-ProjectReaderTests-918728921 None] Lock "cinder-981cfcd7-b96e-430c-b04a-eee30c12368c-delete_volume" released by "delete_volume" :: held 2.295s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Flow 'volume_create_manager' (fe77f2c6-7c1c-4772-b667-be95e4c9cede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1213c7e6-048d-452d-a75e-4eab86ec1785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1213c7e6-048d-452d-a75e-4eab86ec1785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1464100124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2afffaa-2e53-4f13-882c-dd137c66ce0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e9681e658d420d9a4ac07ab7a45b07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:17Z,use_quota=True,user_id='7a36d18a027a43499a0a309b00e798ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656ebe5c-e5c5-4cbe-b316-29b0d1171a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (656ebe5c-e5c5-4cbe-b316-29b0d1171a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907db69d-6b23-418c-a1e5-ec58e00f6f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (907db69d-6b23-418c-a1e5-ec58e00f6f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2afffaa-2e53-4f13-882c-dd137c66ce0c', 'volume_name': 'volume-d2afffaa-2e53-4f13-882c-dd137c66ce0c', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c72b4b-e129-415d-9c4c-f2eb0507263e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c72b4b-e129-415d-9c4c-f2eb0507263e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ead6e4-0849-480d-8663-89e2d6d2d41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:16 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Volume d2afffaa-2e53-4f13-882c-dd137c66ce0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2afffaa-2e53-4f13-882c-dd137c66ce0c', 'volume_size': 1} Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1464100124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2afffaa-2e53-4f13-882c-dd137c66ce0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e9681e658d420d9a4ac07ab7a45b07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:17Z,use_quota=True,user_id='7a36d18a027a43499a0a309b00e798ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Creating volume d2afffaa-2e53-4f13-882c-dd137c66ce0c {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:22:16 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:22:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2afffaa-2e53-4f13-882c-dd137c66ce0c 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:16 devstack sudo[104596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2afffaa-2e53-4f13-882c-dd137c66ce0c 1073741824 Jul 08 01:22:16 devstack sudo[104596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:17 devstack sudo[104596]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2afffaa-2e53-4f13-882c-dd137c66ce0c 1073741824" returned: 0 in 0.858s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2afffaa-2e53-4f13-882c-dd137c66ce0c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:17 devstack sudo[104602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2afffaa-2e53-4f13-882c-dd137c66ce0c Jul 08 01:22:17 devstack sudo[104602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:18 devstack sudo[104602]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2afffaa-2e53-4f13-882c-dd137c66ce0c" returned: 0 in 0.645s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:22:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.546s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ead6e4-0849-480d-8663-89e2d6d2d41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2afffaa-2e53-4f13-882c-dd137c66ce0c', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42975b9-886f-4932-a81e-f3d0bb553c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:18 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Volume volume-d2afffaa-2e53-4f13-882c-dd137c66ce0c (d2afffaa-2e53-4f13-882c-dd137c66ce0c): created successfully Jul 08 01:22:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42975b9-886f-4932-a81e-f3d0bb553c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Flow 'volume_create_manager' (fe77f2c6-7c1c-4772-b667-be95e4c9cede) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:18 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-39aa73ad-11b1-4bed-8088-0466f45616ac tempest-ProjectReaderTests-918728921 None] Created volume successfully. Jul 08 01:22:18 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1e951163-b1d8-4b53-b5d7-be6ec04e665f tempest-ProjectReaderTests-918728921 None] Acquiring lock "cinder-d2afffaa-2e53-4f13-882c-dd137c66ce0c-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:18 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1e951163-b1d8-4b53-b5d7-be6ec04e665f tempest-ProjectReaderTests-918728921 None] Lock "cinder-d2afffaa-2e53-4f13-882c-dd137c66ce0c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:18 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1e951163-b1d8-4b53-b5d7-be6ec04e665f tempest-ProjectReaderTests-918728921 None] Acquiring lock "cinder-quobyte-d2afffaa-2e53-4f13-882c-dd137c66ce0c" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:18 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1e951163-b1d8-4b53-b5d7-be6ec04e665f tempest-ProjectReaderTests-918728921 None] Lock "cinder-quobyte-d2afffaa-2e53-4f13-882c-dd137c66ce0c" acquired by "delete_volume" :: waited 0.014s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:18 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[73522344-3e0a-4b53-aad8-8ee977cd4441]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1e951163-b1d8-4b53-b5d7-be6ec04e665f tempest-ProjectReaderTests-918728921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2afffaa-2e53-4f13-882c-dd137c66ce0c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:19 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2afffaa-2e53-4f13-882c-dd137c66ce0c Jul 08 01:22:19 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:19 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1e951163-b1d8-4b53-b5d7-be6ec04e665f tempest-ProjectReaderTests-918728921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2afffaa-2e53-4f13-882c-dd137c66ce0c" returned: 0 in 0.795s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1e951163-b1d8-4b53-b5d7-be6ec04e665f tempest-ProjectReaderTests-918728921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2afffaa-2e53-4f13-882c-dd137c66ce0c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:19 devstack sudo[104647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2afffaa-2e53-4f13-882c-dd137c66ce0c Jul 08 01:22:19 devstack sudo[104647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:20 devstack sudo[104647]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1e951163-b1d8-4b53-b5d7-be6ec04e665f tempest-ProjectReaderTests-918728921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2afffaa-2e53-4f13-882c-dd137c66ce0c" returned: 0 in 0.660s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1e951163-b1d8-4b53-b5d7-be6ec04e665f tempest-ProjectReaderTests-918728921 None] Lock "cinder-quobyte-d2afffaa-2e53-4f13-882c-dd137c66ce0c" released by "delete_volume" :: held 1.493s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:20 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-1e951163-b1d8-4b53-b5d7-be6ec04e665f tempest-ProjectReaderTests-918728921 None] Created reservations ['f05dad8a-eafe-4fc0-ae66-d1ee6dbf42e1', 'd81e237d-f55d-4c03-b30b-84efff866544', '72b28424-48c1-46ee-846d-d1fcde67bcbe', 'db22cbf7-9ca6-405e-82a4-100716068f67'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:22:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1e951163-b1d8-4b53-b5d7-be6ec04e665f tempest-ProjectReaderTests-918728921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1e951163-b1d8-4b53-b5d7-be6ec04e665f tempest-ProjectReaderTests-918728921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1e951163-b1d8-4b53-b5d7-be6ec04e665f tempest-ProjectReaderTests-918728921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:20 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1e951163-b1d8-4b53-b5d7-be6ec04e665f tempest-ProjectReaderTests-918728921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1e951163-b1d8-4b53-b5d7-be6ec04e665f tempest-ProjectReaderTests-918728921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1e951163-b1d8-4b53-b5d7-be6ec04e665f tempest-ProjectReaderTests-918728921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:20 devstack sudo[104650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:22:20 devstack sudo[104650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:21 devstack sudo[104650]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1e951163-b1d8-4b53-b5d7-be6ec04e665f tempest-ProjectReaderTests-918728921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.680s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-1e951163-b1d8-4b53-b5d7-be6ec04e665f tempest-ProjectReaderTests-918728921 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:22:21 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-1e951163-b1d8-4b53-b5d7-be6ec04e665f tempest-ProjectReaderTests-918728921 None] Deleted volume successfully. Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1e951163-b1d8-4b53-b5d7-be6ec04e665f tempest-ProjectReaderTests-918728921 None] Lock "cinder-d2afffaa-2e53-4f13-882c-dd137c66ce0c-delete_volume" released by "delete_volume" :: held 2.389s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Flow 'volume_create_manager' (5f8ef80c-c531-482d-96d0-6477cb63e4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764c418e-601c-4c62-9963-d2bbf96691fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (764c418e-601c-4c62-9963-d2bbf96691fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2113380614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045aac84-94ec-4544-a817-c512de79c97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e9681e658d420d9a4ac07ab7a45b07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:22Z,use_quota=True,user_id='7a36d18a027a43499a0a309b00e798ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc08c71-2c64-425e-ada6-7086a770d8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc08c71-2c64-425e-ada6-7086a770d8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c5eb5c-d7da-49e9-b551-c0d9a7d6c69f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c5eb5c-d7da-49e9-b551-c0d9a7d6c69f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '045aac84-94ec-4544-a817-c512de79c97b', 'volume_name': 'volume-045aac84-94ec-4544-a817-c512de79c97b', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63321b0c-9b2b-4ebc-9fae-badf1f6e3706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63321b0c-9b2b-4ebc-9fae-badf1f6e3706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d600ed-a14d-49db-94b4-bd4a048319f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:21 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Volume 045aac84-94ec-4544-a817-c512de79c97b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-045aac84-94ec-4544-a817-c512de79c97b', 'volume_size': 1} Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2113380614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=045aac84-94ec-4544-a817-c512de79c97b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e9681e658d420d9a4ac07ab7a45b07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:22Z,use_quota=True,user_id='7a36d18a027a43499a0a309b00e798ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Creating volume 045aac84-94ec-4544-a817-c512de79c97b {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:22:21 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:22:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-045aac84-94ec-4544-a817-c512de79c97b 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:21 devstack sudo[104654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-045aac84-94ec-4544-a817-c512de79c97b 1073741824 Jul 08 01:22:21 devstack sudo[104654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:22 devstack sudo[104654]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-045aac84-94ec-4544-a817-c512de79c97b 1073741824" returned: 0 in 0.871s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-045aac84-94ec-4544-a817-c512de79c97b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:22 devstack sudo[104666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-045aac84-94ec-4544-a817-c512de79c97b Jul 08 01:22:22 devstack sudo[104666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:23 devstack sudo[104666]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-045aac84-94ec-4544-a817-c512de79c97b" returned: 0 in 0.673s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:22:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d600ed-a14d-49db-94b4-bd4a048319f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-045aac84-94ec-4544-a817-c512de79c97b', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd45ba1d-5a49-4116-bd44-a0b4254ef371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:23 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Volume volume-045aac84-94ec-4544-a817-c512de79c97b (045aac84-94ec-4544-a817-c512de79c97b): created successfully Jul 08 01:22:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd45ba1d-5a49-4116-bd44-a0b4254ef371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Flow 'volume_create_manager' (5f8ef80c-c531-482d-96d0-6477cb63e4bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:23 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-7afb037f-27b8-4f47-9b31-705053d36fd9 tempest-ProjectReaderTests-918728921 None] Created volume successfully. Jul 08 01:22:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-26f98f6c-0585-4058-8bdb-b5a14cf54b78 tempest-ProjectReaderTests-918728921 None] Acquiring lock "cinder-045aac84-94ec-4544-a817-c512de79c97b-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-26f98f6c-0585-4058-8bdb-b5a14cf54b78 tempest-ProjectReaderTests-918728921 None] Lock "cinder-045aac84-94ec-4544-a817-c512de79c97b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-26f98f6c-0585-4058-8bdb-b5a14cf54b78 tempest-ProjectReaderTests-918728921 None] Acquiring lock "cinder-quobyte-045aac84-94ec-4544-a817-c512de79c97b" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-26f98f6c-0585-4058-8bdb-b5a14cf54b78 tempest-ProjectReaderTests-918728921 None] Lock "cinder-quobyte-045aac84-94ec-4544-a817-c512de79c97b" acquired by "delete_volume" :: waited 0.017s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:23 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8353cfb-d000-4c9a-bfd5-914dd732cfdf]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-26f98f6c-0585-4058-8bdb-b5a14cf54b78 tempest-ProjectReaderTests-918728921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-045aac84-94ec-4544-a817-c512de79c97b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:23 devstack sudo[104669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-045aac84-94ec-4544-a817-c512de79c97b Jul 08 01:22:23 devstack sudo[104669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:24 devstack sudo[104669]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-26f98f6c-0585-4058-8bdb-b5a14cf54b78 tempest-ProjectReaderTests-918728921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-045aac84-94ec-4544-a817-c512de79c97b" returned: 0 in 0.794s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-26f98f6c-0585-4058-8bdb-b5a14cf54b78 tempest-ProjectReaderTests-918728921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-045aac84-94ec-4544-a817-c512de79c97b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:24 devstack sudo[104674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-045aac84-94ec-4544-a817-c512de79c97b Jul 08 01:22:24 devstack sudo[104674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:25 devstack sudo[104674]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-26f98f6c-0585-4058-8bdb-b5a14cf54b78 tempest-ProjectReaderTests-918728921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-045aac84-94ec-4544-a817-c512de79c97b" returned: 0 in 0.628s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-26f98f6c-0585-4058-8bdb-b5a14cf54b78 tempest-ProjectReaderTests-918728921 None] Lock "cinder-quobyte-045aac84-94ec-4544-a817-c512de79c97b" released by "delete_volume" :: held 1.468s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:25 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-26f98f6c-0585-4058-8bdb-b5a14cf54b78 tempest-ProjectReaderTests-918728921 None] Created reservations ['9545db40-c311-41ae-84e7-9f179f71d3e5', 'a96b62e1-de30-45d9-9b9b-ae3dc8426f5d', '48236285-2cac-4cf1-b54b-5a5b33fdddab', '3582a664-fe78-4cc9-bcc8-cc43ece13fa9'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:22:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-26f98f6c-0585-4058-8bdb-b5a14cf54b78 tempest-ProjectReaderTests-918728921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-26f98f6c-0585-4058-8bdb-b5a14cf54b78 tempest-ProjectReaderTests-918728921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-26f98f6c-0585-4058-8bdb-b5a14cf54b78 tempest-ProjectReaderTests-918728921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-26f98f6c-0585-4058-8bdb-b5a14cf54b78 tempest-ProjectReaderTests-918728921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-26f98f6c-0585-4058-8bdb-b5a14cf54b78 tempest-ProjectReaderTests-918728921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-26f98f6c-0585-4058-8bdb-b5a14cf54b78 tempest-ProjectReaderTests-918728921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:25 devstack sudo[104677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:22:25 devstack sudo[104677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:26 devstack sudo[104677]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-26f98f6c-0585-4058-8bdb-b5a14cf54b78 tempest-ProjectReaderTests-918728921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.634s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-26f98f6c-0585-4058-8bdb-b5a14cf54b78 tempest-ProjectReaderTests-918728921 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:22:26 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-26f98f6c-0585-4058-8bdb-b5a14cf54b78 tempest-ProjectReaderTests-918728921 None] Deleted volume successfully. Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-26f98f6c-0585-4058-8bdb-b5a14cf54b78 tempest-ProjectReaderTests-918728921 None] Lock "cinder-045aac84-94ec-4544-a817-c512de79c97b-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Flow 'volume_create_manager' (f369d117-e17b-4428-9010-2897d443ec82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35bb3133-b9fe-4a29-9dfe-ee7764c8ec68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35bb3133-b9fe-4a29-9dfe-ee7764c8ec68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-813611762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d7767cd-2e14-4a33-b76a-ac97c477a909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e9681e658d420d9a4ac07ab7a45b07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:26Z,use_quota=True,user_id='7a36d18a027a43499a0a309b00e798ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b677597a-8490-48c5-952e-ca1a3c26295e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b677597a-8490-48c5-952e-ca1a3c26295e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca1e2d4-0e44-4980-8ce3-296f3b75a569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ca1e2d4-0e44-4980-8ce3-296f3b75a569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d7767cd-2e14-4a33-b76a-ac97c477a909', 'volume_name': 'volume-8d7767cd-2e14-4a33-b76a-ac97c477a909', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae4b1b2-f7e7-4c7c-9761-0da4979cf127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ae4b1b2-f7e7-4c7c-9761-0da4979cf127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec61705-0ed8-4dab-9968-e2271f62a34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:26 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Volume 8d7767cd-2e14-4a33-b76a-ac97c477a909: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d7767cd-2e14-4a33-b76a-ac97c477a909', 'volume_size': 1} Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-813611762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d7767cd-2e14-4a33-b76a-ac97c477a909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49e9681e658d420d9a4ac07ab7a45b07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:26Z,use_quota=True,user_id='7a36d18a027a43499a0a309b00e798ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Creating volume 8d7767cd-2e14-4a33-b76a-ac97c477a909 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:22:26 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:22:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8d7767cd-2e14-4a33-b76a-ac97c477a909 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:26 devstack sudo[104680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8d7767cd-2e14-4a33-b76a-ac97c477a909 1073741824 Jul 08 01:22:26 devstack sudo[104680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:27 devstack sudo[104680]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8d7767cd-2e14-4a33-b76a-ac97c477a909 1073741824" returned: 0 in 0.902s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8d7767cd-2e14-4a33-b76a-ac97c477a909 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:27 devstack sudo[104685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8d7767cd-2e14-4a33-b76a-ac97c477a909 Jul 08 01:22:27 devstack sudo[104685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:28 devstack sudo[104685]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8d7767cd-2e14-4a33-b76a-ac97c477a909" returned: 0 in 0.666s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:28 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] <== create_volume: return (1609ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:22:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec61705-0ed8-4dab-9968-e2271f62a34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d7767cd-2e14-4a33-b76a-ac97c477a909', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ea1451-79fa-4120-9f01-7f9e391f51ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:28 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Volume volume-8d7767cd-2e14-4a33-b76a-ac97c477a909 (8d7767cd-2e14-4a33-b76a-ac97c477a909): created successfully Jul 08 01:22:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28ea1451-79fa-4120-9f01-7f9e391f51ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:28 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Flow 'volume_create_manager' (f369d117-e17b-4428-9010-2897d443ec82) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:28 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-2dc30d1f-1a81-4e78-8207-373b23e995bf tempest-ProjectReaderTests-918728921 None] Created volume successfully. Jul 08 01:22:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-aa756222-afda-45bc-af15-5aa158516390 tempest-ProjectReaderTests-918728921 None] Acquiring lock "cinder-8d7767cd-2e14-4a33-b76a-ac97c477a909-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-aa756222-afda-45bc-af15-5aa158516390 tempest-ProjectReaderTests-918728921 None] Lock "cinder-8d7767cd-2e14-4a33-b76a-ac97c477a909-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-aa756222-afda-45bc-af15-5aa158516390 tempest-ProjectReaderTests-918728921 None] Acquiring lock "cinder-quobyte-8d7767cd-2e14-4a33-b76a-ac97c477a909" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:22:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-aa756222-afda-45bc-af15-5aa158516390 tempest-ProjectReaderTests-918728921 None] Lock "cinder-quobyte-8d7767cd-2e14-4a33-b76a-ac97c477a909" acquired by "delete_volume" :: waited 0.016s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:22:28 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3105c78-d103-4d76-b281-d7cc63c1c80b]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa756222-afda-45bc-af15-5aa158516390 tempest-ProjectReaderTests-918728921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8d7767cd-2e14-4a33-b76a-ac97c477a909 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:28 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8d7767cd-2e14-4a33-b76a-ac97c477a909 Jul 08 01:22:28 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:29 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa756222-afda-45bc-af15-5aa158516390 tempest-ProjectReaderTests-918728921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8d7767cd-2e14-4a33-b76a-ac97c477a909" returned: 0 in 0.755s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa756222-afda-45bc-af15-5aa158516390 tempest-ProjectReaderTests-918728921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8d7767cd-2e14-4a33-b76a-ac97c477a909 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:29 devstack sudo[104693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8d7767cd-2e14-4a33-b76a-ac97c477a909 Jul 08 01:22:29 devstack sudo[104693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:30 devstack sudo[104693]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa756222-afda-45bc-af15-5aa158516390 tempest-ProjectReaderTests-918728921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8d7767cd-2e14-4a33-b76a-ac97c477a909" returned: 0 in 0.633s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:30 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-aa756222-afda-45bc-af15-5aa158516390 tempest-ProjectReaderTests-918728921 None] Lock "cinder-quobyte-8d7767cd-2e14-4a33-b76a-ac97c477a909" released by "delete_volume" :: held 1.427s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:30 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-aa756222-afda-45bc-af15-5aa158516390 tempest-ProjectReaderTests-918728921 None] Created reservations ['f1bc0147-fc94-4137-a2e1-e0e32fb80575', '25ec2162-464a-4113-beab-ccb910091628', 'aebd2305-3256-483c-9c4e-9aa83b200b9d', '96a21e43-1fac-4663-aa7a-0d6de3b282e9'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:22:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-aa756222-afda-45bc-af15-5aa158516390 tempest-ProjectReaderTests-918728921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-aa756222-afda-45bc-af15-5aa158516390 tempest-ProjectReaderTests-918728921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-aa756222-afda-45bc-af15-5aa158516390 tempest-ProjectReaderTests-918728921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-aa756222-afda-45bc-af15-5aa158516390 tempest-ProjectReaderTests-918728921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-aa756222-afda-45bc-af15-5aa158516390 tempest-ProjectReaderTests-918728921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa756222-afda-45bc-af15-5aa158516390 tempest-ProjectReaderTests-918728921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:30 devstack sudo[104696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:22:30 devstack sudo[104696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:30 devstack sudo[104696]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-aa756222-afda-45bc-af15-5aa158516390 tempest-ProjectReaderTests-918728921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.657s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:30 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-aa756222-afda-45bc-af15-5aa158516390 tempest-ProjectReaderTests-918728921 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:22:30 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-aa756222-afda-45bc-af15-5aa158516390 tempest-ProjectReaderTests-918728921 None] Deleted volume successfully. Jul 08 01:22:30 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-aa756222-afda-45bc-af15-5aa158516390 tempest-ProjectReaderTests-918728921 None] Lock "cinder-8d7767cd-2e14-4a33-b76a-ac97c477a909-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:22:40 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:UPDATE=43,cinder:SELECT=30,cinder:INSERT=9,cinder:DELETE=6 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:22:40 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=26,cinder:UPDATE=45,cinder:INSERT=11,cinder:DELETE=2 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:22:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:22:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:44 devstack sudo[104706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:22:44 devstack sudo[104706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:45 devstack sudo[104706]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.683s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:45 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:22:45 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:22:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 28 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:22:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:22:51 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:22:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Flow 'volume_create_manager' (48d9f3a9-17c8-438b-934f-e2af6add52af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0362cd-a2a4-470a-a202-b0394f7d6fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e0362cd-a2a4-470a-a202-b0394f7d6fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1445427254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=747d6bb9-c346-48be-83a7-21479ec0e672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68e8ebfefd74f5a9541726109f33c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:52Z,use_quota=True,user_id='173decb8d59543f3b1a87cd7dd0214fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6215d4ff-f8a2-4a52-bdd7-02c94cdc1a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6215d4ff-f8a2-4a52-bdd7-02c94cdc1a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad38706-2f37-48ec-aea5-051fe917442c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad38706-2f37-48ec-aea5-051fe917442c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '747d6bb9-c346-48be-83a7-21479ec0e672', 'volume_name': 'volume-747d6bb9-c346-48be-83a7-21479ec0e672', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e1bd4f-f0fa-4066-a8ec-5c6bbd57ed8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47e1bd4f-f0fa-4066-a8ec-5c6bbd57ed8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ad47a5-0698-4179-8960-4b0db0190eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:51 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Volume 747d6bb9-c346-48be-83a7-21479ec0e672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-747d6bb9-c346-48be-83a7-21479ec0e672', 'volume_size': 1} Jul 08 01:22:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1445427254',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=747d6bb9-c346-48be-83a7-21479ec0e672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68e8ebfefd74f5a9541726109f33c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:22:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:22:52Z,use_quota=True,user_id='173decb8d59543f3b1a87cd7dd0214fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:22:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Creating volume 747d6bb9-c346-48be-83a7-21479ec0e672 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:22:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:22:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:22:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:22:51 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:22:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:52 devstack sudo[104710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672 1073741824 Jul 08 01:22:52 devstack sudo[104710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:52 devstack sudo[104710]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672 1073741824" returned: 0 in 0.873s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:52 devstack sudo[104715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672 Jul 08 01:22:52 devstack sudo[104715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:53 devstack sudo[104715]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672" returned: 0 in 0.650s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:53 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:22:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ad47a5-0698-4179-8960-4b0db0190eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-747d6bb9-c346-48be-83a7-21479ec0e672', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7024b8f-80e5-4380-a8e8-d715e5d944a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:22:53 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Volume volume-747d6bb9-c346-48be-83a7-21479ec0e672 (747d6bb9-c346-48be-83a7-21479ec0e672): created successfully Jul 08 01:22:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7024b8f-80e5-4380-a8e8-d715e5d944a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:22:53 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Flow 'volume_create_manager' (48d9f3a9-17c8-438b-934f-e2af6add52af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:22:53 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f8d4ad30-9e46-481d-bc20-cdf790ee3592 tempest-SnapshotDependencyTests-1747299778 None] Created volume successfully. Jul 08 01:22:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-90fce169-b69c-476b-a116-fe574f1dca29 tempest-SnapshotDependencyTests-1747299778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:22:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-90fce169-b69c-476b-a116-fe574f1dca29 tempest-SnapshotDependencyTests-1747299778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:22:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-90fce169-b69c-476b-a116-fe574f1dca29 tempest-SnapshotDependencyTests-1747299778 None] Creating offline snapshot 0954f9be-b743-4ea5-a909-2a4997c79126 of volume 747d6bb9-c346-48be-83a7-21479ec0e672 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:22:54 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[003e7e3c-5b3c-460d-bcad-e272d6fa2247]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:22:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-90fce169-b69c-476b-a116-fe574f1dca29 tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:54 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672 Jul 08 01:22:54 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:55 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-90fce169-b69c-476b-a116-fe574f1dca29 tempest-SnapshotDependencyTests-1747299778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672" returned: 0 in 0.781s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-90fce169-b69c-476b-a116-fe574f1dca29 tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:55 devstack sudo[104723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126 1G Jul 08 01:22:55 devstack sudo[104723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:55 devstack sudo[104723]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-90fce169-b69c-476b-a116-fe574f1dca29 tempest-SnapshotDependencyTests-1747299778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126 1G" returned: 0 in 0.834s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-90fce169-b69c-476b-a116-fe574f1dca29 tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-747d6bb9-c346-48be-83a7-21479ec0e672 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:55 devstack sudo[104728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-747d6bb9-c346-48be-83a7-21479ec0e672 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126 Jul 08 01:22:55 devstack sudo[104728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:56 devstack sudo[104728]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-90fce169-b69c-476b-a116-fe574f1dca29 tempest-SnapshotDependencyTests-1747299778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-747d6bb9-c346-48be-83a7-21479ec0e672 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126" returned: 0 in 0.698s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:56 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-90fce169-b69c-476b-a116-fe574f1dca29 tempest-SnapshotDependencyTests-1747299778 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126 is being set with open permissions: ugo+rw Jul 08 01:22:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-90fce169-b69c-476b-a116-fe574f1dca29 tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:56 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126 Jul 08 01:22:56 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:57 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-90fce169-b69c-476b-a116-fe574f1dca29 tempest-SnapshotDependencyTests-1747299778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126" returned: 0 in 0.656s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-90fce169-b69c-476b-a116-fe574f1dca29 tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:57 devstack sudo[104736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.info Jul 08 01:22:57 devstack sudo[104736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:57 devstack sudo[104736]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-90fce169-b69c-476b-a116-fe574f1dca29 tempest-SnapshotDependencyTests-1747299778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.info" returned: 0 in 0.662s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:57 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-90fce169-b69c-476b-a116-fe574f1dca29 tempest-SnapshotDependencyTests-1747299778 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.info is being set with open permissions: ugo+rw Jul 08 01:22:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-90fce169-b69c-476b-a116-fe574f1dca29 tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:22:57 devstack sudo[104739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.info Jul 08 01:22:57 devstack sudo[104739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:22:58 devstack sudo[104739]: pam_unix(sudo:session): session closed for user root Jul 08 01:22:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-90fce169-b69c-476b-a116-fe574f1dca29 tempest-SnapshotDependencyTests-1747299778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.info" returned: 0 in 0.670s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:22:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-90fce169-b69c-476b-a116-fe574f1dca29 tempest-SnapshotDependencyTests-1747299778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.395s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:22:58 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-90fce169-b69c-476b-a116-fe574f1dca29 tempest-SnapshotDependencyTests-1747299778 None] Create snapshot completed successfully Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Flow 'volume_create_manager' (7b4fd690-bc6f-4000-8d8d-80e76c04da04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4226ae53-0ba8-4036-905d-3b3b955ba83e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4226ae53-0ba8-4036-905d-3b3b955ba83e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=492a32af-ef51-42dd-b76b-79d83d61ff7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f68e8ebfefd74f5a9541726109f33c41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0954f9be-b743-4ea5-a909-2a4997c79126,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:00Z,use_quota=True,user_id='173decb8d59543f3b1a87cd7dd0214fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf0c2cf-b424-4d1d-9eac-a39f5bf66847) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daf0c2cf-b424-4d1d-9eac-a39f5bf66847) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad59e0a-b3ae-4d01-92ba-558570349284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ad59e0a-b3ae-4d01-92ba-558570349284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '492a32af-ef51-42dd-b76b-79d83d61ff7e', 'volume_name': 'volume-492a32af-ef51-42dd-b76b-79d83d61ff7e', 'volume_size': 1, 'snapshot_id': '0954f9be-b743-4ea5-a909-2a4997c79126'}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b766e2-0ba9-45b9-bede-c9884b50adc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97b766e2-0ba9-45b9-bede-c9884b50adc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1959af44-7655-4a26-bcd9-bb450f8812c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:00 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Volume 492a32af-ef51-42dd-b76b-79d83d61ff7e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-492a32af-ef51-42dd-b76b-79d83d61ff7e', 'volume_size': 1, 'snapshot_id': '0954f9be-b743-4ea5-a909-2a4997c79126'} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Acquiring lock "cinder-quobyte-0954f9be-b743-4ea5-a909-2a4997c79126-492a32af-ef51-42dd-b76b-79d83d61ff7e" by "_create_volume_from_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Lock "cinder-quobyte-0954f9be-b743-4ea5-a909-2a4997c79126-492a32af-ef51-42dd-b76b-79d83d61ff7e" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Creating volume 492a32af-ef51-42dd-b76b-79d83d61ff7e from snapshot 0954f9be-b743-4ea5-a909-2a4997c79126 {{(pid=87123) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Acquiring lock "cinder-quobyte-492a32af-ef51-42dd-b76b-79d83d61ff7e" by "_copy_volume_from_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Lock "cinder-quobyte-492a32af-ef51-42dd-b76b-79d83d61ff7e" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] snapshot: 0954f9be-b743-4ea5-a909-2a4997c79126, volume: 492a32af-ef51-42dd-b76b-79d83d61ff7e, {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6087f2-d39d-4d51-ab77-20161f38e4df]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:00 devstack sudo[104742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126 Jul 08 01:23:00 devstack sudo[104742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:01 devstack sudo[104742]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126" returned: 0 in 0.839s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-747d6bb9-c346-48be-83a7-21479ec0e672(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:23:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672 {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:23:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Creating direct copy from snapshot {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:23:01 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[a122aebf-8026-4ff4-8fbe-3f38e07a11f5]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:01 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672 Jul 08 01:23:01 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:01 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672" returned: 0 in 0.825s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:01 devstack cinder-volume[87123]: DEBUG cinder.utils [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Path /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-492a32af-ef51-42dd-b76b-79d83d61ff7e not found in is_blk_device check {{(pid=87123) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:23:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-492a32af-ef51-42dd-b76b-79d83d61ff7e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:01 devstack sudo[104753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-492a32af-ef51-42dd-b76b-79d83d61ff7e Jul 08 01:23:01 devstack sudo[104753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:06 devstack sudo[104753]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-492a32af-ef51-42dd-b76b-79d83d61ff7e" returned: 0 in 4.521s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:06 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7e9f8b8-22de-4450-8951-acd3eeea14b9]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:06 devstack sudo[104766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672 Jul 08 01:23:06 devstack sudo[104766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:07 devstack sudo[104766]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672" returned: 0 in 0.937s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:07 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Image conversion details: src /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672, size 1024.00 MB, duration 4.52 sec, destination /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-492a32af-ef51-42dd-b76b-79d83d61ff7e {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:23:07 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Converted 1024.00 MB image at 226.45 MB/s Jul 08 01:23:07 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-492a32af-ef51-42dd-b76b-79d83d61ff7e is being set with open permissions: ugo+rw Jul 08 01:23:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-492a32af-ef51-42dd-b76b-79d83d61ff7e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:07 devstack sudo[104771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-492a32af-ef51-42dd-b76b-79d83d61ff7e Jul 08 01:23:07 devstack sudo[104771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:08 devstack sudo[104771]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-492a32af-ef51-42dd-b76b-79d83d61ff7e" returned: 0 in 0.634s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:08 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Lock "cinder-quobyte-492a32af-ef51-42dd-b76b-79d83d61ff7e" released by "_copy_volume_from_snapshot" :: held 7.855s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:08 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Lock "cinder-quobyte-0954f9be-b743-4ea5-a909-2a4997c79126-492a32af-ef51-42dd-b76b-79d83d61ff7e" released by "_create_volume_from_snapshot" :: held 7.888s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.905s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1959af44-7655-4a26-bcd9-bb450f8812c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-492a32af-ef51-42dd-b76b-79d83d61ff7e', 'volume_size': 1, 'snapshot_id': '0954f9be-b743-4ea5-a909-2a4997c79126'}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485dfa03-5bd6-4644-8fa1-8145e235c7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:08 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Volume volume-492a32af-ef51-42dd-b76b-79d83d61ff7e (492a32af-ef51-42dd-b76b-79d83d61ff7e): created successfully Jul 08 01:23:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (485dfa03-5bd6-4644-8fa1-8145e235c7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Flow 'volume_create_manager' (7b4fd690-bc6f-4000-8d8d-80e76c04da04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:08 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-45a12715-574f-4a43-9005-b12c2ba5f376 tempest-SnapshotDependencyTests-1747299778 None] Created volume successfully. Jul 08 01:23:08 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-65a9606d-6779-436f-a35b-f823b059fa7e tempest-SnapshotDependencyTests-1747299778 None] Acquiring lock "cinder-0954f9be-b743-4ea5-a909-2a4997c79126-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:08 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-65a9606d-6779-436f-a35b-f823b059fa7e tempest-SnapshotDependencyTests-1747299778 None] Lock "cinder-0954f9be-b743-4ea5-a909-2a4997c79126-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:08 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-65a9606d-6779-436f-a35b-f823b059fa7e tempest-SnapshotDependencyTests-1747299778 None] Acquiring lock "cinder-quobyte-747d6bb9-c346-48be-83a7-21479ec0e672" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:08 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-65a9606d-6779-436f-a35b-f823b059fa7e tempest-SnapshotDependencyTests-1747299778 None] Lock "cinder-quobyte-747d6bb9-c346-48be-83a7-21479ec0e672" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:08 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-65a9606d-6779-436f-a35b-f823b059fa7e tempest-SnapshotDependencyTests-1747299778 None] Acquiring lock "cinder-quobyte-0954f9be-b743-4ea5-a909-2a4997c79126" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:08 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-65a9606d-6779-436f-a35b-f823b059fa7e tempest-SnapshotDependencyTests-1747299778 None] Lock "cinder-quobyte-0954f9be-b743-4ea5-a909-2a4997c79126" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:08 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-65a9606d-6779-436f-a35b-f823b059fa7e tempest-SnapshotDependencyTests-1747299778 None] Deleting offline snapshot 0954f9be-b743-4ea5-a909-2a4997c79126 of volume 747d6bb9-c346-48be-83a7-21479ec0e672 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:23:08 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-65a9606d-6779-436f-a35b-f823b059fa7e tempest-SnapshotDependencyTests-1747299778 None] snapshot_file for this snap is: volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:23:08 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d900dfb-e7fa-40a0-a173-375c73e6e19a]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-65a9606d-6779-436f-a35b-f823b059fa7e tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:08 devstack sudo[104774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126 Jul 08 01:23:08 devstack sudo[104774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:09 devstack sudo[104774]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-65a9606d-6779-436f-a35b-f823b059fa7e tempest-SnapshotDependencyTests-1747299778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126" returned: 0 in 0.770s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-65a9606d-6779-436f-a35b-f823b059fa7e tempest-SnapshotDependencyTests-1747299778 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-747d6bb9-c346-48be-83a7-21479ec0e672(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:23:09 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b23cde-ac86-4ace-a237-6fee103bafe8]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-65a9606d-6779-436f-a35b-f823b059fa7e tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:09 devstack sudo[104779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672 Jul 08 01:23:09 devstack sudo[104779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:10 devstack sudo[104779]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-65a9606d-6779-436f-a35b-f823b059fa7e tempest-SnapshotDependencyTests-1747299778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672" returned: 0 in 0.776s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-65a9606d-6779-436f-a35b-f823b059fa7e tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:10 devstack sudo[104784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126 Jul 08 01:23:10 devstack sudo[104784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:11 devstack sudo[104784]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-65a9606d-6779-436f-a35b-f823b059fa7e tempest-SnapshotDependencyTests-1747299778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126" returned: 0 in 0.768s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-65a9606d-6779-436f-a35b-f823b059fa7e tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:11 devstack sudo[104790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126 Jul 08 01:23:11 devstack sudo[104790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:11 devstack sudo[104790]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-65a9606d-6779-436f-a35b-f823b059fa7e tempest-SnapshotDependencyTests-1747299778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672.0954f9be-b743-4ea5-a909-2a4997c79126" returned: 0 in 0.646s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:11 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-65a9606d-6779-436f-a35b-f823b059fa7e tempest-SnapshotDependencyTests-1747299778 None] Lock "cinder-quobyte-0954f9be-b743-4ea5-a909-2a4997c79126" released by "_delete_snapshot" :: held 3.064s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:11 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-65a9606d-6779-436f-a35b-f823b059fa7e tempest-SnapshotDependencyTests-1747299778 None] Lock "cinder-quobyte-747d6bb9-c346-48be-83a7-21479ec0e672" released by "delete_snapshot" :: held 3.091s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:11 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-65a9606d-6779-436f-a35b-f823b059fa7e tempest-SnapshotDependencyTests-1747299778 None] Created reservations ['b1237131-9009-4d0d-aa32-4e8b32e2c5fb', '2477a940-0932-4f0b-aad4-b748c0f7d2a0', 'cced34ee-5b42-4e7b-8542-08d3d244d608', 'a5efe747-2969-45c7-86bd-d0cf3429c904'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:23:12 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-65a9606d-6779-436f-a35b-f823b059fa7e tempest-SnapshotDependencyTests-1747299778 None] Delete snapshot completed successfully. Jul 08 01:23:12 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-65a9606d-6779-436f-a35b-f823b059fa7e tempest-SnapshotDependencyTests-1747299778 None] Lock "cinder-0954f9be-b743-4ea5-a909-2a4997c79126-delete_snapshot" released by "delete_snapshot" :: held 3.260s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:12 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-edbdb692-5441-4f17-ac78-6f5abcf1ab7c tempest-SnapshotDependencyTests-1747299778 None] Acquiring lock "cinder-747d6bb9-c346-48be-83a7-21479ec0e672-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-edbdb692-5441-4f17-ac78-6f5abcf1ab7c tempest-SnapshotDependencyTests-1747299778 None] Lock "cinder-747d6bb9-c346-48be-83a7-21479ec0e672-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-edbdb692-5441-4f17-ac78-6f5abcf1ab7c tempest-SnapshotDependencyTests-1747299778 None] Acquiring lock "cinder-quobyte-747d6bb9-c346-48be-83a7-21479ec0e672" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-edbdb692-5441-4f17-ac78-6f5abcf1ab7c tempest-SnapshotDependencyTests-1747299778 None] Lock "cinder-quobyte-747d6bb9-c346-48be-83a7-21479ec0e672" acquired by "delete_volume" :: waited 0.015s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:13 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[20433e3b-af53-4a61-a07d-121902b2c751]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-edbdb692-5441-4f17-ac78-6f5abcf1ab7c tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:13 devstack sudo[104793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672 Jul 08 01:23:13 devstack sudo[104793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:13 devstack sudo[104793]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-edbdb692-5441-4f17-ac78-6f5abcf1ab7c tempest-SnapshotDependencyTests-1747299778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672" returned: 0 in 0.791s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-edbdb692-5441-4f17-ac78-6f5abcf1ab7c tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:13 devstack sudo[104798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672 Jul 08 01:23:13 devstack sudo[104798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:14 devstack sudo[104798]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-edbdb692-5441-4f17-ac78-6f5abcf1ab7c tempest-SnapshotDependencyTests-1747299778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-747d6bb9-c346-48be-83a7-21479ec0e672" returned: 0 in 0.701s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-edbdb692-5441-4f17-ac78-6f5abcf1ab7c tempest-SnapshotDependencyTests-1747299778 None] Lock "cinder-quobyte-747d6bb9-c346-48be-83a7-21479ec0e672" released by "delete_volume" :: held 1.554s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:14 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-edbdb692-5441-4f17-ac78-6f5abcf1ab7c tempest-SnapshotDependencyTests-1747299778 None] Created reservations ['b6f330ff-5626-4098-9b80-8fa586c4984d', 'd7e0cda9-8efe-4a56-8265-14a3a9e13d92', 'af428e42-e9b8-4233-b573-40224636652a', '9b03c702-f595-494d-b8bd-40d7c3490813'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:23:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-edbdb692-5441-4f17-ac78-6f5abcf1ab7c tempest-SnapshotDependencyTests-1747299778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-edbdb692-5441-4f17-ac78-6f5abcf1ab7c tempest-SnapshotDependencyTests-1747299778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:14 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-edbdb692-5441-4f17-ac78-6f5abcf1ab7c tempest-SnapshotDependencyTests-1747299778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:14 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-edbdb692-5441-4f17-ac78-6f5abcf1ab7c tempest-SnapshotDependencyTests-1747299778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-edbdb692-5441-4f17-ac78-6f5abcf1ab7c tempest-SnapshotDependencyTests-1747299778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-edbdb692-5441-4f17-ac78-6f5abcf1ab7c tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:14 devstack sudo[104801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:23:14 devstack sudo[104801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:15 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-255406ce-445e-47bf-9ba0-4a52182b618e tempest-SnapshotDependencyTests-1747299778 None] Acquiring lock "cinder-492a32af-ef51-42dd-b76b-79d83d61ff7e-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:15 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-255406ce-445e-47bf-9ba0-4a52182b618e tempest-SnapshotDependencyTests-1747299778 None] Lock "cinder-492a32af-ef51-42dd-b76b-79d83d61ff7e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:15 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-255406ce-445e-47bf-9ba0-4a52182b618e tempest-SnapshotDependencyTests-1747299778 None] Acquiring lock "cinder-quobyte-492a32af-ef51-42dd-b76b-79d83d61ff7e" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:15 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-255406ce-445e-47bf-9ba0-4a52182b618e tempest-SnapshotDependencyTests-1747299778 None] Lock "cinder-quobyte-492a32af-ef51-42dd-b76b-79d83d61ff7e" acquired by "delete_volume" :: waited 0.017s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:15 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec908a59-42e0-4c85-8302-3a21a9025b31]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-255406ce-445e-47bf-9ba0-4a52182b618e tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-492a32af-ef51-42dd-b76b-79d83d61ff7e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:15 devstack sudo[104801]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-edbdb692-5441-4f17-ac78-6f5abcf1ab7c tempest-SnapshotDependencyTests-1747299778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.703s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:15 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-edbdb692-5441-4f17-ac78-6f5abcf1ab7c tempest-SnapshotDependencyTests-1747299778 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:23:15 devstack sudo[104804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-492a32af-ef51-42dd-b76b-79d83d61ff7e Jul 08 01:23:15 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-edbdb692-5441-4f17-ac78-6f5abcf1ab7c tempest-SnapshotDependencyTests-1747299778 None] Deleted volume successfully. Jul 08 01:23:15 devstack sudo[104804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:15 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-edbdb692-5441-4f17-ac78-6f5abcf1ab7c tempest-SnapshotDependencyTests-1747299778 None] Lock "cinder-747d6bb9-c346-48be-83a7-21479ec0e672-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:16 devstack sudo[104804]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-255406ce-445e-47bf-9ba0-4a52182b618e tempest-SnapshotDependencyTests-1747299778 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-492a32af-ef51-42dd-b76b-79d83d61ff7e" returned: 0 in 0.788s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-255406ce-445e-47bf-9ba0-4a52182b618e tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-492a32af-ef51-42dd-b76b-79d83d61ff7e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:16 devstack sudo[104809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-492a32af-ef51-42dd-b76b-79d83d61ff7e Jul 08 01:23:16 devstack sudo[104809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:16 devstack sudo[104809]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-255406ce-445e-47bf-9ba0-4a52182b618e tempest-SnapshotDependencyTests-1747299778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-492a32af-ef51-42dd-b76b-79d83d61ff7e" returned: 0 in 0.701s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-255406ce-445e-47bf-9ba0-4a52182b618e tempest-SnapshotDependencyTests-1747299778 None] Lock "cinder-quobyte-492a32af-ef51-42dd-b76b-79d83d61ff7e" released by "delete_volume" :: held 1.533s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:16 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-255406ce-445e-47bf-9ba0-4a52182b618e tempest-SnapshotDependencyTests-1747299778 None] Created reservations ['34406f99-9fec-410d-bc36-852e11f60465', '0c3cae8d-f721-4806-8af5-d698e02e7737', '5da1643f-5eaa-4451-8589-f44335c3d036', 'f1a8bd84-ae1f-43d6-8b7e-85cdf69d7cf9'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:23:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-255406ce-445e-47bf-9ba0-4a52182b618e tempest-SnapshotDependencyTests-1747299778 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-255406ce-445e-47bf-9ba0-4a52182b618e tempest-SnapshotDependencyTests-1747299778 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-255406ce-445e-47bf-9ba0-4a52182b618e tempest-SnapshotDependencyTests-1747299778 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-255406ce-445e-47bf-9ba0-4a52182b618e tempest-SnapshotDependencyTests-1747299778 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-255406ce-445e-47bf-9ba0-4a52182b618e tempest-SnapshotDependencyTests-1747299778 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-255406ce-445e-47bf-9ba0-4a52182b618e tempest-SnapshotDependencyTests-1747299778 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:17 devstack sudo[104812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:23:17 devstack sudo[104812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:17 devstack sudo[104812]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-255406ce-445e-47bf-9ba0-4a52182b618e tempest-SnapshotDependencyTests-1747299778 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.728s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:17 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-255406ce-445e-47bf-9ba0-4a52182b618e tempest-SnapshotDependencyTests-1747299778 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:23:17 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-255406ce-445e-47bf-9ba0-4a52182b618e tempest-SnapshotDependencyTests-1747299778 None] Deleted volume successfully. Jul 08 01:23:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-255406ce-445e-47bf-9ba0-4a52182b618e tempest-SnapshotDependencyTests-1747299778 None] Lock "cinder-492a32af-ef51-42dd-b76b-79d83d61ff7e-delete_volume" released by "delete_volume" :: held 2.509s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:26 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=21,cinder:UPDATE=30,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:23:27 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:UPDATE=27,cinder:SELECT=27,cinder:DELETE=4,cinder:INSERT=6 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Flow 'volume_create_manager' (5556ff4e-1325-42a0-ac2a-6711ee970709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde1499b-03b9-4a17-a526-6b610139bddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dde1499b-03b9-4a17-a526-6b610139bddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2051409332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be0dcbe-f9ce-48b5-9396-8338b87943ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e61d0902694664a5703d80af8ac83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:38Z,use_quota=True,user_id='69cc3bd98bae43cdb20ac1749e028ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cefe6ae-9a8e-49a4-94b6-9342375cf4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cefe6ae-9a8e-49a4-94b6-9342375cf4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff897833-a9d8-4a22-b7a6-982b37af55ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff897833-a9d8-4a22-b7a6-982b37af55ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2be0dcbe-f9ce-48b5-9396-8338b87943ce', 'volume_name': 'volume-2be0dcbe-f9ce-48b5-9396-8338b87943ce', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a530f622-e46b-445b-bd3a-dac1561cd0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a530f622-e46b-445b-bd3a-dac1561cd0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32df4dc-dc00-4a75-a8d4-a9bc86cbf907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:38 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Volume 2be0dcbe-f9ce-48b5-9396-8338b87943ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2be0dcbe-f9ce-48b5-9396-8338b87943ce', 'volume_size': 1} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2051409332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2be0dcbe-f9ce-48b5-9396-8338b87943ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e61d0902694664a5703d80af8ac83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:38Z,use_quota=True,user_id='69cc3bd98bae43cdb20ac1749e028ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Creating volume 2be0dcbe-f9ce-48b5-9396-8338b87943ce {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:23:38 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2be0dcbe-f9ce-48b5-9396-8338b87943ce 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:38 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2be0dcbe-f9ce-48b5-9396-8338b87943ce 1073741824 Jul 08 01:23:38 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Flow 'volume_create_manager' (0644401f-a359-4c65-bcd0-92fed4b4a7e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca8cc24-e383-4551-9a14-1bcfedd68dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ca8cc24-e383-4551-9a14-1bcfedd68dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-639011072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e76761-33e7-4657-b000-2fecaf9e8f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a68656f1a5d40f4bdd0cd49f4b7743b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:39Z,use_quota=True,user_id='7f4ae980fa3f46ed99dc59ce3f534f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c051636-8f41-4ead-bc69-8d66f1e7fb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c051636-8f41-4ead-bc69-8d66f1e7fb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81dba8e4-df5f-4311-8fd0-05dc2955ae55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81dba8e4-df5f-4311-8fd0-05dc2955ae55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4e76761-33e7-4657-b000-2fecaf9e8f03', 'volume_name': 'volume-c4e76761-33e7-4657-b000-2fecaf9e8f03', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd89599-b804-4db2-91bb-9c6e34cd9f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd89599-b804-4db2-91bb-9c6e34cd9f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef9b803-1ae8-411e-8b91-0e2b54747f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:38 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Volume c4e76761-33e7-4657-b000-2fecaf9e8f03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4e76761-33e7-4657-b000-2fecaf9e8f03', 'volume_size': 1} Jul 08 01:23:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Flow 'volume_create_manager' (9ab647bd-ad33-445c-96ea-c16bbd57d340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80287389-e7e5-49a3-ac4d-b679e506f1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80287389-e7e5-49a3-ac4d-b679e506f1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1751346195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4624035d-8b7b-449a-a930-67c2381fe01d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e61d0902694664a5703d80af8ac83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:39Z,use_quota=True,user_id='69cc3bd98bae43cdb20ac1749e028ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b1cf2b-89ef-4a23-9094-03cd5f3811a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7b1cf2b-89ef-4a23-9094-03cd5f3811a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71a82a55-4861-4540-88cc-6f0cf158c0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71a82a55-4861-4540-88cc-6f0cf158c0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4624035d-8b7b-449a-a930-67c2381fe01d', 'volume_name': 'volume-4624035d-8b7b-449a-a930-67c2381fe01d', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59980468-f800-4329-adf8-1bd078b69c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59980468-f800-4329-adf8-1bd078b69c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8fdaa8-a62c-4d71-a6bb-52261391dc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Volume 4624035d-8b7b-449a-a930-67c2381fe01d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4624035d-8b7b-449a-a930-67c2381fe01d', 'volume_size': 1} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Flow 'volume_create_manager' (401f1c19-e1cc-433c-98df-4b448f613e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc5ded6c-5e0e-4cfd-bdb8-db9cd634f738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc5ded6c-5e0e-4cfd-bdb8-db9cd634f738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-143652470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e61d0902694664a5703d80af8ac83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:39Z,use_quota=True,user_id='69cc3bd98bae43cdb20ac1749e028ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ad2cd1-325b-42dd-9db1-abd5328de36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ad2cd1-325b-42dd-9db1-abd5328de36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e6cf95-97b6-49fd-837d-2e87d94958b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e6cf95-97b6-49fd-837d-2e87d94958b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce', 'volume_name': 'volume-69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c5f92a-d894-4df4-8188-1db87cfe58e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1c5f92a-d894-4df4-8188-1db87cfe58e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b0535e-c7f0-4b71-8650-f36244a69b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Volume 69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce', 'volume_size': 1} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Flow 'volume_create_manager' (b6019470-63c1-4c96-8c1d-3e583a7079db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a212d6e6-9695-428c-9512-6190c3f9d08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a212d6e6-9695-428c-9512-6190c3f9d08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1512467636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44988a46-143d-4943-9518-97f4d160404c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e61d0902694664a5703d80af8ac83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:40Z,use_quota=True,user_id='69cc3bd98bae43cdb20ac1749e028ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e95710-dc02-49a8-a966-2a932b4779c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55e95710-dc02-49a8-a966-2a932b4779c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:39 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee304e13-5fee-4d3e-8cfe-b2a6942acd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee304e13-5fee-4d3e-8cfe-b2a6942acd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44988a46-143d-4943-9518-97f4d160404c', 'volume_name': 'volume-44988a46-143d-4943-9518-97f4d160404c', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17b4950-f704-4744-a1ea-983940aa0a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e17b4950-f704-4744-a1ea-983940aa0a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1359ef29-8643-4b8e-a701-becca728d513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:39 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Volume 44988a46-143d-4943-9518-97f4d160404c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44988a46-143d-4943-9518-97f4d160404c', 'volume_size': 1} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2be0dcbe-f9ce-48b5-9396-8338b87943ce 1073741824" returned: 0 in 1.546s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2be0dcbe-f9ce-48b5-9396-8338b87943ce {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:39 devstack sudo[104912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2be0dcbe-f9ce-48b5-9396-8338b87943ce Jul 08 01:23:39 devstack sudo[104912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Flow 'volume_create_manager' (28ee3555-f43c-41d8-b62f-8e3c0ba5552a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6221bb9-5c34-47dc-a424-4e1cbc8e16c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6221bb9-5c34-47dc-a424-4e1cbc8e16c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2129071519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cadc4157-0bda-4f4e-ba50-7c916465690a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e61d0902694664a5703d80af8ac83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:40Z,use_quota=True,user_id='69cc3bd98bae43cdb20ac1749e028ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87da146f-bca3-488d-9e28-58d1a6837856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87da146f-bca3-488d-9e28-58d1a6837856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b81b811-8134-4452-80a8-d8ad4e8e7305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b81b811-8134-4452-80a8-d8ad4e8e7305) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cadc4157-0bda-4f4e-ba50-7c916465690a', 'volume_name': 'volume-cadc4157-0bda-4f4e-ba50-7c916465690a', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1f00b5-e47f-4e5d-87b0-c48a9ea2a0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e1f00b5-e47f-4e5d-87b0-c48a9ea2a0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43128c5c-0a32-42af-b9c9-0a66379802ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:40 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Volume cadc4157-0bda-4f4e-ba50-7c916465690a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cadc4157-0bda-4f4e-ba50-7c916465690a', 'volume_size': 1} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:40 devstack sudo[104912]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2be0dcbe-f9ce-48b5-9396-8338b87943ce" returned: 0 in 0.824s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] <== create_volume: return (2421ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.424s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.812s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-639011072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4e76761-33e7-4657-b000-2fecaf9e8f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a68656f1a5d40f4bdd0cd49f4b7743b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:39Z,use_quota=True,user_id='7f4ae980fa3f46ed99dc59ce3f534f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Creating volume c4e76761-33e7-4657-b000-2fecaf9e8f03 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:23:40 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c32df4dc-dc00-4a75-a8d4-a9bc86cbf907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2be0dcbe-f9ce-48b5-9396-8338b87943ce', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4626fdd-5447-4f82-9783-971cdcf4f485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:40 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 1073741824 Jul 08 01:23:40 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:40 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Volume volume-2be0dcbe-f9ce-48b5-9396-8338b87943ce (2be0dcbe-f9ce-48b5-9396-8338b87943ce): created successfully Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4626fdd-5447-4f82-9783-971cdcf4f485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Flow 'volume_create_manager' (5556ff4e-1325-42a0-ac2a-6711ee970709) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:40 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-800daaf1-7dac-4d0b-b974-069c8dd0fe64 tempest-CreateVolumesFromImageTest-1133715748 None] Created volume successfully. Jul 08 01:23:41 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:23:41 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Flow 'volume_create_manager' (885f813c-90af-4374-a180-cc90ec2ff9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f215f4f-eb80-4e3e-b7a8-760eaf02432c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 1073741824" returned: 0 in 1.100s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f215f4f-eb80-4e3e-b7a8-760eaf02432c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe72d962edf44b49a5ac0adb6e1fb1bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:42Z,use_quota=True,user_id='03019562072f45fd940ef0d3c4bf61ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2701e452-e5ed-48e7-b903-990397948904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2701e452-e5ed-48e7-b903-990397948904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:41 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4410d4-1531-4ba3-9b00-106e3cb2249d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:41 devstack cinder-volume[87123]: DEBUG cinder.image.glance [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Creating Keystone auth plugin from conf {{(pid=87123) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:23:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:41 devstack sudo[104922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 Jul 08 01:23:41 devstack sudo[104922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4410d4-1531-4ba3-9b00-106e3cb2249d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e', 'volume_name': 'volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e', 'volume_size': 1, 'image_id': '59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '90adcc07843dae9e2e3ab2fd276bc85a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fe72d962edf44b49a5ac0adb6e1fb1bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '594e5c2a0663213c67f7f00d8d9c3271c6ee057413de24319c10d7af3c1322837a249b0c80a50a19e6b2cb4f177d8f01a547ebef42f935b1c417c64d92cc768c', 'id': '59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad', 'created_at': datetime.datetime(2026, 7, 7, 23, 23, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 23, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad/file', 'properties': {}}, 'image_service': }' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d359374-c198-4673-b656-eca67e5cae1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d359374-c198-4673-b656-eca67e5cae1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047c93eb-9e84-4ec1-9229-6a5e968182da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:42 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Volume f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e', 'volume_size': 1, 'image_id': '59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '90adcc07843dae9e2e3ab2fd276bc85a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fe72d962edf44b49a5ac0adb6e1fb1bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '594e5c2a0663213c67f7f00d8d9c3271c6ee057413de24319c10d7af3c1322837a249b0c80a50a19e6b2cb4f177d8f01a547ebef42f935b1c417c64d92cc768c', 'id': '59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad', 'created_at': datetime.datetime(2026, 7, 7, 23, 23, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 23, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad/file', 'properties': {}}, 'image_service': } Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Trying to clone f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e from image 59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad at location (None, [{'url': 'file:///opt/stack/data/glance/images/59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad', 'metadata': {}}]). {{(pid=87123) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:23:42 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Image download 0.00 MB at 0.00 MB/s Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffa233e-f907-490e-951e-355268076888]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:42 devstack sudo[104924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD Jul 08 01:23:42 devstack sudo[104924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:42 devstack sudo[104922]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03" returned: 0 in 0.815s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] <== create_volume: return (1991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.998s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.566s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1751346195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4624035d-8b7b-449a-a930-67c2381fe01d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e61d0902694664a5703d80af8ac83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:39Z,use_quota=True,user_id='69cc3bd98bae43cdb20ac1749e028ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Creating volume 4624035d-8b7b-449a-a930-67c2381fe01d {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:23:42 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4624035d-8b7b-449a-a930-67c2381fe01d 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:42 devstack sudo[104927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4624035d-8b7b-449a-a930-67c2381fe01d 1073741824 Jul 08 01:23:42 devstack sudo[104927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef9b803-1ae8-411e-8b91-0e2b54747f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4e76761-33e7-4657-b000-2fecaf9e8f03', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270e227b-7274-4d44-8cb8-96fde185ad3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:42 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Volume volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 (c4e76761-33e7-4657-b000-2fecaf9e8f03): created successfully Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (270e227b-7274-4d44-8cb8-96fde185ad3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Flow 'volume_create_manager' (0644401f-a359-4c65-bcd0-92fed4b4a7e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:42 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-7a6d04c3-815b-4d50-9f03-d81d4222ec29 tempest-VolumeDependencyTests-1686982014 None] Created volume successfully. Jul 08 01:23:43 devstack sudo[104924]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD" returned: 0 in 0.939s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:43 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:23:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Flow 'volume_create_manager' (8fe955db-b258-4f1f-95c1-f90c80537cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f118a3f-cf87-4aa7-9610-368d2cbc3afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f118a3f-cf87-4aa7-9610-368d2cbc3afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbab89e7-61f2-4e74-943c-ad075fa61df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1ce8c37a9e432bb7a52891ddf63810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:43Z,use_quota=True,user_id='9c6760a54fa84920976be5c000836568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aacf5bf5-f408-47f9-8a05-46ae34ac1283),volume_type_id=aacf5bf5-f408-47f9-8a05-46ae34ac1283)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3fc0107-a53d-40c0-b70d-daacfa3cf8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3fc0107-a53d-40c0-b70d-daacfa3cf8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:43 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD Jul 08 01:23:43 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6e3fea5-430c-4a58-865b-11c17024a79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:43 devstack cinder-volume[87123]: DEBUG cinder.image.glance [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Creating Keystone auth plugin from conf {{(pid=87123) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 08 01:23:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6e3fea5-430c-4a58-865b-11c17024a79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bbab89e7-61f2-4e74-943c-ad075fa61df6', 'volume_name': 'volume-bbab89e7-61f2-4e74-943c-ad075fa61df6', 'volume_size': 1, 'image_id': '0a3d0461-cc04-4dd1-a06c-2559aa148b3d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a3d0461-cc04-4dd1-a06c-2559aa148b3d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a354c48c1085840b34a28cefdbc79881', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'da1ce8c37a9e432bb7a52891ddf63810', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '177f6997e3db5eb021cba3338c97da5697d47029b9bdb2fda85f47f855c20fa02557445beeed183334b52f9f755ca69526e46d04d5b3cbd667321919acf9ea38', 'id': '0a3d0461-cc04-4dd1-a06c-2559aa148b3d', 'created_at': datetime.datetime(2026, 7, 7, 23, 23, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a3d0461-cc04-4dd1-a06c-2559aa148b3d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5facdaed-c7c1-4687-b096-ac921d212333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5facdaed-c7c1-4687-b096-ac921d212333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:43 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef473da5-afe0-4a6e-8987-41bfe0025b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:43 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Volume bbab89e7-61f2-4e74-943c-ad075fa61df6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bbab89e7-61f2-4e74-943c-ad075fa61df6', 'volume_size': 1, 'image_id': '0a3d0461-cc04-4dd1-a06c-2559aa148b3d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a3d0461-cc04-4dd1-a06c-2559aa148b3d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a354c48c1085840b34a28cefdbc79881', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'da1ce8c37a9e432bb7a52891ddf63810', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '177f6997e3db5eb021cba3338c97da5697d47029b9bdb2fda85f47f855c20fa02557445beeed183334b52f9f755ca69526e46d04d5b3cbd667321919acf9ea38', 'id': '0a3d0461-cc04-4dd1-a06c-2559aa148b3d', 'created_at': datetime.datetime(2026, 7, 7, 23, 23, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a3d0461-cc04-4dd1-a06c-2559aa148b3d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 08 01:23:43 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Trying to clone bbab89e7-61f2-4e74-943c-ad075fa61df6 from image 0a3d0461-cc04-4dd1-a06c-2559aa148b3d at location (None, [{'url': 'file:///opt/stack/data/glance/images/0a3d0461-cc04-4dd1-a06c-2559aa148b3d', 'metadata': {}}]). {{(pid=87123) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 08 01:23:43 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 08 01:23:43 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Image download 0.00 MB at 0.00 MB/s Jul 08 01:23:43 devstack sudo[104927]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4624035d-8b7b-449a-a930-67c2381fe01d 1073741824" returned: 0 in 1.028s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4624035d-8b7b-449a-a930-67c2381fe01d {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:43 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e940b23-1496-4fc1-8956-4817fd5624dd]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:43 devstack sudo[104939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4624035d-8b7b-449a-a930-67c2381fe01d Jul 08 01:23:43 devstack sudo[104939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:43 devstack sudo[104940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD Jul 08 01:23:43 devstack sudo[104940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8a756af7-0f42-444b-b3c5-14e84757eec5 tempest-VolumeDependencyTests-1686982014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:44 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD" returned: 1 in 0.891s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Temporary image 59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad is fetched for user 03019562072f45fd940ef0d3c4bf61ac. {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[847a404f-ac3e-469d-8738-1bebc1f0c7b2]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:44 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD Jul 08 01:23:44 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:44 devstack sudo[104939]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4624035d-8b7b-449a-a930-67c2381fe01d" returned: 0 in 0.812s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.921s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.246s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-143652470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e61d0902694664a5703d80af8ac83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:39Z,use_quota=True,user_id='69cc3bd98bae43cdb20ac1749e028ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Creating volume 69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:23:44 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:44 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce 1073741824 Jul 08 01:23:44 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8fdaa8-a62c-4d71-a6bb-52261391dc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4624035d-8b7b-449a-a930-67c2381fe01d', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:44 devstack sudo[104940]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a841b24-47c2-47e3-b4d1-6dbb6a4ea759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD" returned: 0 in 0.870s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:44 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Volume volume-4624035d-8b7b-449a-a930-67c2381fe01d (4624035d-8b7b-449a-a930-67c2381fe01d): created successfully Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a841b24-47c2-47e3-b4d1-6dbb6a4ea759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Flow 'volume_create_manager' (9ab647bd-ad33-445c-96ea-c16bbd57d340) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:44 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-76c729bb-a04c-4db2-bda4-34f1f79cc2fb tempest-CreateVolumesFromImageTest-1133715748 None] Created volume successfully. Jul 08 01:23:44 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD Jul 08 01:23:44 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:44 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:23:44 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:45 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD" returned: 0 in 0.880s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:45 devstack sudo[104959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD Jul 08 01:23:45 devstack sudo[104959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:45 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD" returned: 1 in 0.976s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:23:45 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Temporary image 0a3d0461-cc04-4dd1-a06c-2559aa148b3d is fetched for user 9c6760a54fa84920976be5c000836568. {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 08 01:23:45 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce 1073741824" returned: 0 in 1.049s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:45 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.824s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:45 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:23:45 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:23:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 28 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:23:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:23:45 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce Jul 08 01:23:45 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:45 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce9a7e4-0348-48b2-94a1-2efb44a76bc6]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:45 devstack sudo[104970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD Jul 08 01:23:45 devstack sudo[104970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:46 devstack sudo[104959]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD" returned: 1 in 0.938s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:23:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:46 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce" returned: 0 in 0.687s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:23:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.610s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1512467636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44988a46-143d-4943-9518-97f4d160404c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e61d0902694664a5703d80af8ac83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:40Z,use_quota=True,user_id='69cc3bd98bae43cdb20ac1749e028ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:23:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Creating volume 44988a46-143d-4943-9518-97f4d160404c {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:23:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:23:46 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:23:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-44988a46-143d-4943-9518-97f4d160404c 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40b0535e-c7f0-4b71-8650-f36244a69b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf656f25-6772-4074-88f7-ba9a80468086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:46 devstack sudo[104976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-44988a46-143d-4943-9518-97f4d160404c 1073741824 Jul 08 01:23:46 devstack sudo[104976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:46 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Volume volume-69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce (69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce): created successfully Jul 08 01:23:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf656f25-6772-4074-88f7-ba9a80468086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Flow 'volume_create_manager' (401f1c19-e1cc-433c-98df-4b448f613e47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:46 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-38db98b9-7477-4914-98f8-beafbf3d7f12 tempest-CreateVolumesFromImageTest-1133715748 None] Created volume successfully. Jul 08 01:23:46 devstack sudo[104970]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD" returned: 0 in 0.821s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:46 devstack sudo[104980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD Jul 08 01:23:46 devstack sudo[104980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:47 devstack sudo[104976]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-44988a46-143d-4943-9518-97f4d160404c 1073741824" returned: 0 in 0.855s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-44988a46-143d-4943-9518-97f4d160404c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:47 devstack sudo[104980]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD" returned: 1 in 0.760s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:23:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:47 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-44988a46-143d-4943-9518-97f4d160404c Jul 08 01:23:47 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:48 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-44988a46-143d-4943-9518-97f4d160404c" returned: 0 in 0.668s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:23:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.909s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2129071519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cadc4157-0bda-4f4e-ba50-7c916465690a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='42e61d0902694664a5703d80af8ac83f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:40Z,use_quota=True,user_id='69cc3bd98bae43cdb20ac1749e028ea6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:23:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Creating volume cadc4157-0bda-4f4e-ba50-7c916465690a {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:23:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:23:48 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:23:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cadc4157-0bda-4f4e-ba50-7c916465690a 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:48 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cadc4157-0bda-4f4e-ba50-7c916465690a 1073741824 Jul 08 01:23:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1359ef29-8643-4b8e-a701-becca728d513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44988a46-143d-4943-9518-97f4d160404c', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:48 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f932b362-e319-4b18-b74d-bb4a80d88498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:48 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Volume volume-44988a46-143d-4943-9518-97f4d160404c (44988a46-143d-4943-9518-97f4d160404c): created successfully Jul 08 01:23:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f932b362-e319-4b18-b74d-bb4a80d88498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Flow 'volume_create_manager' (b6019470-63c1-4c96-8c1d-3e583a7079db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:48 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-219259a2-4ec9-42b4-b5e8-f8558fa463f2 tempest-CreateVolumesFromImageTest-1133715748 None] Created volume successfully. Jul 08 01:23:48 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cadc4157-0bda-4f4e-ba50-7c916465690a 1073741824" returned: 0 in 0.899s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cadc4157-0bda-4f4e-ba50-7c916465690a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:49 devstack sudo[104997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cadc4157-0bda-4f4e-ba50-7c916465690a Jul 08 01:23:49 devstack sudo[104997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:49 devstack sudo[104997]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cadc4157-0bda-4f4e-ba50-7c916465690a" returned: 0 in 0.694s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:49 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:23:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8a756af7-0f42-444b-b3c5-14e84757eec5 tempest-VolumeDependencyTests-1686982014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.604s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:49 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43128c5c-0a32-42af-b9c9-0a66379802ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cadc4157-0bda-4f4e-ba50-7c916465690a', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:49 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d91426-6a38-4945-a86a-b7322859093f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:49 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-8a756af7-0f42-444b-b3c5-14e84757eec5 tempest-VolumeDependencyTests-1686982014 None] Creating offline snapshot 41cb3ae2-27b4-44b9-967e-8bf188945a18 of volume c4e76761-33e7-4657-b000-2fecaf9e8f03 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:23:49 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Volume volume-cadc4157-0bda-4f4e-ba50-7c916465690a (cadc4157-0bda-4f4e-ba50-7c916465690a): created successfully Jul 08 01:23:49 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98d91426-6a38-4945-a86a-b7322859093f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:49 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Flow 'volume_create_manager' (28ee3555-f43c-41d8-b62f-8e3c0ba5552a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:49 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19c62a0-16eb-4f80-bdfd-31edc38ce003]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8a756af7-0f42-444b-b3c5-14e84757eec5 tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:49 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b6a0e7be-893b-4167-9bde-b63c1f2b4b0f tempest-CreateVolumesFromImageTest-1133715748 None] Created volume successfully. Jul 08 01:23:49 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 Jul 08 01:23:49 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:49 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6baa0d3e-d941-4044-b2a8-6740fdee1b47 tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "cinder-cadc4157-0bda-4f4e-ba50-7c916465690a-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:49 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6baa0d3e-d941-4044-b2a8-6740fdee1b47 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "cinder-cadc4157-0bda-4f4e-ba50-7c916465690a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:50 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6baa0d3e-d941-4044-b2a8-6740fdee1b47 tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "cinder-quobyte-cadc4157-0bda-4f4e-ba50-7c916465690a" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:50 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6baa0d3e-d941-4044-b2a8-6740fdee1b47 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "cinder-quobyte-cadc4157-0bda-4f4e-ba50-7c916465690a" acquired by "delete_volume" :: waited 0.016s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:50 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[66c38574-4590-4b5b-bf1a-917307c501b8]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6baa0d3e-d941-4044-b2a8-6740fdee1b47 tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cadc4157-0bda-4f4e-ba50-7c916465690a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:50 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cadc4157-0bda-4f4e-ba50-7c916465690a Jul 08 01:23:50 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:50 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8a756af7-0f42-444b-b3c5-14e84757eec5 tempest-VolumeDependencyTests-1686982014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03" returned: 0 in 0.824s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8a756af7-0f42-444b-b3c5-14e84757eec5 tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:50 devstack sudo[105007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18 1G Jul 08 01:23:50 devstack sudo[105007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:50 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6baa0d3e-d941-4044-b2a8-6740fdee1b47 tempest-CreateVolumesFromImageTest-1133715748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cadc4157-0bda-4f4e-ba50-7c916465690a" returned: 0 in 0.839s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6baa0d3e-d941-4044-b2a8-6740fdee1b47 tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cadc4157-0bda-4f4e-ba50-7c916465690a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:50 devstack sudo[105013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cadc4157-0bda-4f4e-ba50-7c916465690a Jul 08 01:23:50 devstack sudo[105013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:51 devstack sudo[105007]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8a756af7-0f42-444b-b3c5-14e84757eec5 tempest-VolumeDependencyTests-1686982014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18 1G" returned: 0 in 0.871s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8a756af7-0f42-444b-b3c5-14e84757eec5 tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:51 devstack sudo[105019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18 Jul 08 01:23:51 devstack sudo[105019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:51 devstack sudo[105013]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6baa0d3e-d941-4044-b2a8-6740fdee1b47 tempest-CreateVolumesFromImageTest-1133715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-cadc4157-0bda-4f4e-ba50-7c916465690a" returned: 0 in 0.653s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:51 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6baa0d3e-d941-4044-b2a8-6740fdee1b47 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "cinder-quobyte-cadc4157-0bda-4f4e-ba50-7c916465690a" released by "delete_volume" :: held 1.536s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:51 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-6baa0d3e-d941-4044-b2a8-6740fdee1b47 tempest-CreateVolumesFromImageTest-1133715748 None] Created reservations ['c49b1230-ca4e-4f34-9c65-1a1370003151', '0d942080-c058-4ea6-b225-f964d07a8712', '5163c5a8-e712-4455-ba58-441c66682572', '0cba77e6-2677-4ac9-9a46-4548b2c41bd4'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:23:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6baa0d3e-d941-4044-b2a8-6740fdee1b47 tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6baa0d3e-d941-4044-b2a8-6740fdee1b47 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6baa0d3e-d941-4044-b2a8-6740fdee1b47 tempest-CreateVolumesFromImageTest-1133715748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6baa0d3e-d941-4044-b2a8-6740fdee1b47 tempest-CreateVolumesFromImageTest-1133715748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6baa0d3e-d941-4044-b2a8-6740fdee1b47 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6baa0d3e-d941-4044-b2a8-6740fdee1b47 tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:51 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:23:51 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:52 devstack sudo[105019]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8a756af7-0f42-444b-b3c5-14e84757eec5 tempest-VolumeDependencyTests-1686982014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18" returned: 0 in 0.706s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:52 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-8a756af7-0f42-444b-b3c5-14e84757eec5 tempest-VolumeDependencyTests-1686982014 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18 is being set with open permissions: ugo+rw Jul 08 01:23:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8a756af7-0f42-444b-b3c5-14e84757eec5 tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:52 devstack sudo[105026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18 Jul 08 01:23:52 devstack sudo[105026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a129bb36-83d2-4073-94b1-58a99947f85a tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "cinder-44988a46-143d-4943-9518-97f4d160404c-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a129bb36-83d2-4073-94b1-58a99947f85a tempest-CreateVolumesFromImageTest-1133715748 None] Lock "cinder-44988a46-143d-4943-9518-97f4d160404c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a129bb36-83d2-4073-94b1-58a99947f85a tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "cinder-quobyte-44988a46-143d-4943-9518-97f4d160404c" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a129bb36-83d2-4073-94b1-58a99947f85a tempest-CreateVolumesFromImageTest-1133715748 None] Lock "cinder-quobyte-44988a46-143d-4943-9518-97f4d160404c" acquired by "delete_volume" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:52 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8548ac9-794d-47e6-93a6-6cab6099fb31]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a129bb36-83d2-4073-94b1-58a99947f85a tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-44988a46-143d-4943-9518-97f4d160404c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:52 devstack sudo[105028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-44988a46-143d-4943-9518-97f4d160404c Jul 08 01:23:52 devstack sudo[105028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:52 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6baa0d3e-d941-4044-b2a8-6740fdee1b47 tempest-CreateVolumesFromImageTest-1133715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.782s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:52 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-6baa0d3e-d941-4044-b2a8-6740fdee1b47 tempest-CreateVolumesFromImageTest-1133715748 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:23:52 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-6baa0d3e-d941-4044-b2a8-6740fdee1b47 tempest-CreateVolumesFromImageTest-1133715748 None] Deleted volume successfully. Jul 08 01:23:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6baa0d3e-d941-4044-b2a8-6740fdee1b47 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "cinder-cadc4157-0bda-4f4e-ba50-7c916465690a-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:52 devstack sudo[105026]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8a756af7-0f42-444b-b3c5-14e84757eec5 tempest-VolumeDependencyTests-1686982014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18" returned: 0 in 0.781s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8a756af7-0f42-444b-b3c5-14e84757eec5 tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:53 devstack sudo[105034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.info Jul 08 01:23:53 devstack sudo[105034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:53 devstack sudo[105028]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a129bb36-83d2-4073-94b1-58a99947f85a tempest-CreateVolumesFromImageTest-1133715748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-44988a46-143d-4943-9518-97f4d160404c" returned: 0 in 0.873s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a129bb36-83d2-4073-94b1-58a99947f85a tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-44988a46-143d-4943-9518-97f4d160404c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:53 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-44988a46-143d-4943-9518-97f4d160404c Jul 08 01:23:53 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:53 devstack sudo[105034]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8a756af7-0f42-444b-b3c5-14e84757eec5 tempest-VolumeDependencyTests-1686982014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.info" returned: 0 in 0.698s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:53 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-8a756af7-0f42-444b-b3c5-14e84757eec5 tempest-VolumeDependencyTests-1686982014 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.info is being set with open permissions: ugo+rw Jul 08 01:23:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8a756af7-0f42-444b-b3c5-14e84757eec5 tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:53 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.info Jul 08 01:23:53 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:53 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a129bb36-83d2-4073-94b1-58a99947f85a tempest-CreateVolumesFromImageTest-1133715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-44988a46-143d-4943-9518-97f4d160404c" returned: 0 in 0.760s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a129bb36-83d2-4073-94b1-58a99947f85a tempest-CreateVolumesFromImageTest-1133715748 None] Lock "cinder-quobyte-44988a46-143d-4943-9518-97f4d160404c" released by "delete_volume" :: held 1.693s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-a129bb36-83d2-4073-94b1-58a99947f85a tempest-CreateVolumesFromImageTest-1133715748 None] Created reservations ['4f6e3d7f-e06a-4ab3-8610-52dd0c37c700', 'fab3b376-08e9-4cf4-8ad6-a68d2a9c305d', '8377236b-ee3b-452c-9a22-5b68b243c23c', 'a36bfeff-8d4e-42f1-91f0-afdaf6897e2f'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a129bb36-83d2-4073-94b1-58a99947f85a tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a129bb36-83d2-4073-94b1-58a99947f85a tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a129bb36-83d2-4073-94b1-58a99947f85a tempest-CreateVolumesFromImageTest-1133715748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a129bb36-83d2-4073-94b1-58a99947f85a tempest-CreateVolumesFromImageTest-1133715748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a129bb36-83d2-4073-94b1-58a99947f85a tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a129bb36-83d2-4073-94b1-58a99947f85a tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:54 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:23:54 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:54 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8a756af7-0f42-444b-b3c5-14e84757eec5 tempest-VolumeDependencyTests-1686982014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.info" returned: 0 in 0.746s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8a756af7-0f42-444b-b3c5-14e84757eec5 tempest-VolumeDependencyTests-1686982014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.773s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.423s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe72d962edf44b49a5ac0adb6e1fb1bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:42Z,use_quota=True,user_id='03019562072f45fd940ef0d3c4bf61ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Creating volume f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:23:54 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:54 devstack sudo[105048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e 1073741824 Jul 08 01:23:54 devstack sudo[105048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-db336d82-d9b5-4700-9f5c-2666e40c8eef tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "cinder-69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:54 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-8a756af7-0f42-444b-b3c5-14e84757eec5 tempest-VolumeDependencyTests-1686982014 None] Create snapshot completed successfully Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-db336d82-d9b5-4700-9f5c-2666e40c8eef tempest-CreateVolumesFromImageTest-1133715748 None] Lock "cinder-69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-db336d82-d9b5-4700-9f5c-2666e40c8eef tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "cinder-quobyte-69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-db336d82-d9b5-4700-9f5c-2666e40c8eef tempest-CreateVolumesFromImageTest-1133715748 None] Lock "cinder-quobyte-69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce" acquired by "delete_volume" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[04567c5d-4168-4b67-8175-327d09907334]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-db336d82-d9b5-4700-9f5c-2666e40c8eef tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:54 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce Jul 08 01:23:54 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:54 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a129bb36-83d2-4073-94b1-58a99947f85a tempest-CreateVolumesFromImageTest-1133715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.774s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-a129bb36-83d2-4073-94b1-58a99947f85a tempest-CreateVolumesFromImageTest-1133715748 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:23:54 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-a129bb36-83d2-4073-94b1-58a99947f85a tempest-CreateVolumesFromImageTest-1133715748 None] Deleted volume successfully. Jul 08 01:23:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a129bb36-83d2-4073-94b1-58a99947f85a tempest-CreateVolumesFromImageTest-1133715748 None] Lock "cinder-44988a46-143d-4943-9518-97f4d160404c-delete_volume" released by "delete_volume" :: held 2.713s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:55 devstack sudo[105048]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e 1073741824" returned: 0 in 0.908s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:55 devstack sudo[105060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e Jul 08 01:23:55 devstack sudo[105060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:55 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-db336d82-d9b5-4700-9f5c-2666e40c8eef tempest-CreateVolumesFromImageTest-1133715748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce" returned: 0 in 0.884s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-db336d82-d9b5-4700-9f5c-2666e40c8eef tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:55 devstack sudo[105062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce Jul 08 01:23:55 devstack sudo[105062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:56 devstack sudo[105060]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e" returned: 0 in 0.770s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] <== create_volume: return (1771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.873s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbab89e7-61f2-4e74-943c-ad075fa61df6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da1ce8c37a9e432bb7a52891ddf63810',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:43Z,use_quota=True,user_id='9c6760a54fa84920976be5c000836568',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(aacf5bf5-f408-47f9-8a05-46ae34ac1283),volume_type_id=aacf5bf5-f408-47f9-8a05-46ae34ac1283)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Creating volume bbab89e7-61f2-4e74-943c-ad075fa61df6 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:23:56 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:23:56 devstack sudo[105066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6 1073741824 Jul 08 01:23:56 devstack sudo[105066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Flow 'volume_create_manager' (1b86145e-6550-4c9a-b7d6-b5c3ea47cc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd0b491-22b0-42cb-b2c5-f6df1f270464) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Attempting download of 59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad ((None, [{'url': 'file:///opt/stack/data/glance/images/59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad', 'metadata': {}}])) to volume f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e. {{(pid=87123) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bd0b491-22b0-42cb-b2c5-f6df1f270464) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:23:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-832185777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ef90718-676a-4e61-b8e5-2b25f5f54da9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a68656f1a5d40f4bdd0cd49f4b7743b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=41cb3ae2-27b4-44b9-967e-8bf188945a18,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:23:56Z,use_quota=True,user_id='7f4ae980fa3f46ed99dc59ce3f534f91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48dc3182-5283-4822-a2e8-bc2913b4c5bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48dc3182-5283-4822-a2e8-bc2913b4c5bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:56 devstack sudo[105062]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901ad557-2784-4bae-a390-55bdb96ec16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (901ad557-2784-4bae-a390-55bdb96ec16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3ef90718-676a-4e61-b8e5-2b25f5f54da9', 'volume_name': 'volume-3ef90718-676a-4e61-b8e5-2b25f5f54da9', 'volume_size': 1, 'snapshot_id': '41cb3ae2-27b4-44b9-967e-8bf188945a18'}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3908b261-4c59-4e0d-a674-0d1d9be35644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3908b261-4c59-4e0d-a674-0d1d9be35644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdfa928c-fc79-493c-827e-b8a0ab728579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:23:56 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Volume 3ef90718-676a-4e61-b8e5-2b25f5f54da9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3ef90718-676a-4e61-b8e5-2b25f5f54da9', 'volume_size': 1, 'snapshot_id': '41cb3ae2-27b4-44b9-967e-8bf188945a18'} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-db336d82-d9b5-4700-9f5c-2666e40c8eef tempest-CreateVolumesFromImageTest-1133715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce" returned: 0 in 0.834s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-db336d82-d9b5-4700-9f5c-2666e40c8eef tempest-CreateVolumesFromImageTest-1133715748 None] Lock "cinder-quobyte-69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce" released by "delete_volume" :: held 1.776s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[810b5e48-939f-4cfa-b69c-49f8bb0c700f]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_bee8wrgs {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-db336d82-d9b5-4700-9f5c-2666e40c8eef tempest-CreateVolumesFromImageTest-1133715748 None] Created reservations ['65ae1169-f038-4e06-91c5-d3b720d11e96', '58850594-e3fe-4073-b800-642f13cdf75c', '6e119327-ec26-48e7-9b11-4ac4bff84712', 'efb845c7-350a-45af-b464-e5d03a49c8a2'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:23:56 devstack sudo[105068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_bee8wrgs Jul 08 01:23:56 devstack sudo[105068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-db336d82-d9b5-4700-9f5c-2666e40c8eef tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-db336d82-d9b5-4700-9f5c-2666e40c8eef tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-db336d82-d9b5-4700-9f5c-2666e40c8eef tempest-CreateVolumesFromImageTest-1133715748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-db336d82-d9b5-4700-9f5c-2666e40c8eef tempest-CreateVolumesFromImageTest-1133715748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-db336d82-d9b5-4700-9f5c-2666e40c8eef tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-db336d82-d9b5-4700-9f5c-2666e40c8eef tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:56 devstack sudo[105070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:23:56 devstack sudo[105070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f6c92e25-4028-44e4-a6f9-c8643b3e45c0 tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "cinder-4624035d-8b7b-449a-a930-67c2381fe01d-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f6c92e25-4028-44e4-a6f9-c8643b3e45c0 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "cinder-4624035d-8b7b-449a-a930-67c2381fe01d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f6c92e25-4028-44e4-a6f9-c8643b3e45c0 tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "cinder-quobyte-4624035d-8b7b-449a-a930-67c2381fe01d" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f6c92e25-4028-44e4-a6f9-c8643b3e45c0 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "cinder-quobyte-4624035d-8b7b-449a-a930-67c2381fe01d" acquired by "delete_volume" :: waited 0.025s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cabea0-d5c7-466c-928d-13a6a605e5cb]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6c92e25-4028-44e4-a6f9-c8643b3e45c0 tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4624035d-8b7b-449a-a930-67c2381fe01d {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:57 devstack sudo[105075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4624035d-8b7b-449a-a930-67c2381fe01d Jul 08 01:23:57 devstack sudo[105075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:57 devstack sudo[105066]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6 1073741824" returned: 0 in 1.053s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:57 devstack sudo[105068]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_bee8wrgs" returned: 0 in 0.856s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_bee8wrgs {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:57 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6 Jul 08 01:23:57 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:57 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_bee8wrgs Jul 08 01:23:57 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:57 devstack sudo[105070]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-db336d82-d9b5-4700-9f5c-2666e40c8eef tempest-CreateVolumesFromImageTest-1133715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.851s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:57 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-db336d82-d9b5-4700-9f5c-2666e40c8eef tempest-CreateVolumesFromImageTest-1133715748 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:23:57 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-db336d82-d9b5-4700-9f5c-2666e40c8eef tempest-CreateVolumesFromImageTest-1133715748 None] Deleted volume successfully. Jul 08 01:23:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-db336d82-d9b5-4700-9f5c-2666e40c8eef tempest-CreateVolumesFromImageTest-1133715748 None] Lock "cinder-69d16db7-aee2-4e8b-a5ff-03a0a3ffd5ce-delete_volume" released by "delete_volume" :: held 2.916s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:57 devstack sudo[105075]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6c92e25-4028-44e4-a6f9-c8643b3e45c0 tempest-CreateVolumesFromImageTest-1133715748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4624035d-8b7b-449a-a930-67c2381fe01d" returned: 0 in 0.912s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6c92e25-4028-44e4-a6f9-c8643b3e45c0 tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4624035d-8b7b-449a-a930-67c2381fe01d {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:57 devstack sudo[105087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4624035d-8b7b-449a-a930-67c2381fe01d Jul 08 01:23:57 devstack sudo[105087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:58 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6" returned: 0 in 0.708s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] <== create_volume: return (1829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.833s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.648s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Acquiring lock "cinder-quobyte-41cb3ae2-27b4-44b9-967e-8bf188945a18-3ef90718-676a-4e61-b8e5-2b25f5f54da9" by "_create_volume_from_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Lock "cinder-quobyte-41cb3ae2-27b4-44b9-967e-8bf188945a18-3ef90718-676a-4e61-b8e5-2b25f5f54da9" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Creating volume 3ef90718-676a-4e61-b8e5-2b25f5f54da9 from snapshot 41cb3ae2-27b4-44b9-967e-8bf188945a18 {{(pid=87123) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Acquiring lock "cinder-quobyte-3ef90718-676a-4e61-b8e5-2b25f5f54da9" by "_copy_volume_from_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Attempting download of 0a3d0461-cc04-4dd1-a06c-2559aa148b3d ((None, [{'url': 'file:///opt/stack/data/glance/images/0a3d0461-cc04-4dd1-a06c-2559aa148b3d', 'metadata': {}}])) to volume bbab89e7-61f2-4e74-943c-ad075fa61df6. {{(pid=87123) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Lock "cinder-quobyte-3ef90718-676a-4e61-b8e5-2b25f5f54da9" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] snapshot: 41cb3ae2-27b4-44b9-967e-8bf188945a18, volume: 3ef90718-676a-4e61-b8e5-2b25f5f54da9, {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:23:58 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_bee8wrgs" returned: 1 in 0.828s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_bee8wrgs' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22393f2-1bd0-4cd8-a22e-254da643f5f3]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[a993b908-266d-4b52-b1cf-dcaee7411d6d]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[76566a1c-fd05-49a1-9154-1c2d9b1b2636]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_rr9julkc {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:58 devstack sudo[105092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD Jul 08 01:23:58 devstack sudo[105092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:58 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18 Jul 08 01:23:58 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:58 devstack sudo[105094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_rr9julkc Jul 08 01:23:58 devstack sudo[105094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:58 devstack sudo[105087]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6c92e25-4028-44e4-a6f9-c8643b3e45c0 tempest-CreateVolumesFromImageTest-1133715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4624035d-8b7b-449a-a930-67c2381fe01d" returned: 0 in 0.758s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f6c92e25-4028-44e4-a6f9-c8643b3e45c0 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "cinder-quobyte-4624035d-8b7b-449a-a930-67c2381fe01d" released by "delete_volume" :: held 1.715s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-f6c92e25-4028-44e4-a6f9-c8643b3e45c0 tempest-CreateVolumesFromImageTest-1133715748 None] Created reservations ['7e2d5130-64ae-48b7-be72-3da8b015313a', '4adbb884-1897-4b44-9353-73e26ab92fd2', 'ef8fab5e-f50c-4a95-bde1-15e9b4fa1c8e', '26880eb0-895a-4e5e-8e5f-7f68fdccbd13'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f6c92e25-4028-44e4-a6f9-c8643b3e45c0 tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f6c92e25-4028-44e4-a6f9-c8643b3e45c0 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f6c92e25-4028-44e4-a6f9-c8643b3e45c0 tempest-CreateVolumesFromImageTest-1133715748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f6c92e25-4028-44e4-a6f9-c8643b3e45c0 tempest-CreateVolumesFromImageTest-1133715748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f6c92e25-4028-44e4-a6f9-c8643b3e45c0 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:23:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6c92e25-4028-44e4-a6f9-c8643b3e45c0 tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:58 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:23:58 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:59 devstack sudo[105092]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD" returned: 0 in 0.842s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:59 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD Jul 08 01:23:59 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:59 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:59 devstack sudo[105094]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3bb329e1-7c20-414d-a37f-434778213de1 tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "cinder-2be0dcbe-f9ce-48b5-9396-8338b87943ce-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18" returned: 0 in 0.907s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_rr9julkc" returned: 0 in 0.882s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4e76761-33e7-4657-b000-2fecaf9e8f03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:23:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:23:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Creating direct copy from snapshot {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:23:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_rr9julkc {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:59 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6785f1d-dbde-4a83-a42a-22fab7d01f48]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3bb329e1-7c20-414d-a37f-434778213de1 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "cinder-2be0dcbe-f9ce-48b5-9396-8338b87943ce-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3bb329e1-7c20-414d-a37f-434778213de1 tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "cinder-quobyte-2be0dcbe-f9ce-48b5-9396-8338b87943ce" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:23:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3bb329e1-7c20-414d-a37f-434778213de1 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "cinder-quobyte-2be0dcbe-f9ce-48b5-9396-8338b87943ce" acquired by "delete_volume" :: waited 0.035s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:23:59 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_rr9julkc Jul 08 01:23:59 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:59 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[5effae1c-2d62-44fe-a8fd-3d4e2c15e262]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:23:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3bb329e1-7c20-414d-a37f-434778213de1 tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2be0dcbe-f9ce-48b5-9396-8338b87943ce {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:23:59 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 Jul 08 01:23:59 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:59 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2be0dcbe-f9ce-48b5-9396-8338b87943ce Jul 08 01:23:59 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:23:59 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Jul 08 01:23:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6c92e25-4028-44e4-a6f9-c8643b3e45c0 tempest-CreateVolumesFromImageTest-1133715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.956s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:23:59 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-f6c92e25-4028-44e4-a6f9-c8643b3e45c0 tempest-CreateVolumesFromImageTest-1133715748 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:23:59 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f6c92e25-4028-44e4-a6f9-c8643b3e45c0 tempest-CreateVolumesFromImageTest-1133715748 None] Deleted volume successfully. Jul 08 01:23:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f6c92e25-4028-44e4-a6f9-c8643b3e45c0 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "cinder-4624035d-8b7b-449a-a930-67c2381fe01d-delete_volume" released by "delete_volume" :: held 2.922s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:00 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD" returned: 1 in 1.041s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:24:00 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] 59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad was raw, converting to raw {{(pid=87123) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:24:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:00 devstack sudo[105120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e Jul 08 01:24:00 devstack sudo[105120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:00 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_rr9julkc" returned: 1 in 1.060s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_rr9julkc' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:24:00 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b7aa8f9-0d36-49e6-9531-9a89d8ae4ce2]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:00 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03" returned: 0 in 1.054s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:00 devstack cinder-volume[87123]: DEBUG cinder.utils [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Path /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3ef90718-676a-4e61-b8e5-2b25f5f54da9 not found in is_blk_device check {{(pid=87123) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:24:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3ef90718-676a-4e61-b8e5-2b25f5f54da9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:00 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3ef90718-676a-4e61-b8e5-2b25f5f54da9 Jul 08 01:24:00 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:00 devstack sudo[105130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD Jul 08 01:24:00 devstack sudo[105130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:00 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3bb329e1-7c20-414d-a37f-434778213de1 tempest-CreateVolumesFromImageTest-1133715748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2be0dcbe-f9ce-48b5-9396-8338b87943ce" returned: 0 in 0.977s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3bb329e1-7c20-414d-a37f-434778213de1 tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2be0dcbe-f9ce-48b5-9396-8338b87943ce {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:00 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2be0dcbe-f9ce-48b5-9396-8338b87943ce Jul 08 01:24:00 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:00 devstack sudo[105120]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e" returned: 0 in 0.871s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:00 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad_64t7y5lpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:24:00 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 01:24:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:00 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e 1G Jul 08 01:24:00 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:01 devstack sudo[105130]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD" returned: 0 in 0.845s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:01 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3bb329e1-7c20-414d-a37f-434778213de1 tempest-CreateVolumesFromImageTest-1133715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2be0dcbe-f9ce-48b5-9396-8338b87943ce" returned: 0 in 0.736s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:01 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3bb329e1-7c20-414d-a37f-434778213de1 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "cinder-quobyte-2be0dcbe-f9ce-48b5-9396-8338b87943ce" released by "delete_volume" :: held 1.793s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:01 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-3bb329e1-7c20-414d-a37f-434778213de1 tempest-CreateVolumesFromImageTest-1133715748 None] Created reservations ['7e39b42b-9001-4bbf-93e4-29c8a5862e3a', 'd9a7d8a3-5ce1-404e-b0a1-df97eb5ef5d2', '6e869463-2194-4edc-9e4d-8703e71c56ba', '66365899-1fd5-4b84-a27c-7cf1130fb7d1'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:01 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD Jul 08 01:24:01 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3bb329e1-7c20-414d-a37f-434778213de1 tempest-CreateVolumesFromImageTest-1133715748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3bb329e1-7c20-414d-a37f-434778213de1 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3bb329e1-7c20-414d-a37f-434778213de1 tempest-CreateVolumesFromImageTest-1133715748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-3bb329e1-7c20-414d-a37f-434778213de1 tempest-CreateVolumesFromImageTest-1133715748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-3bb329e1-7c20-414d-a37f-434778213de1 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3bb329e1-7c20-414d-a37f-434778213de1 tempest-CreateVolumesFromImageTest-1133715748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:01 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:24:01 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:02 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e 1G" returned: 0 in 1.756s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:02 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[44aab8b0-07b8-4808-a6e4-c6c02b74e16b]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:03 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD" returned: 1 in 2.005s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:24:03 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] 0a3d0461-cc04-4dd1-a06c-2559aa148b3d was raw, converting to raw {{(pid=87123) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 08 01:24:03 devstack sudo[105166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e Jul 08 01:24:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:03 devstack sudo[105166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:03 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6 Jul 08 01:24:03 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:03 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3bb329e1-7c20-414d-a37f-434778213de1 tempest-CreateVolumesFromImageTest-1133715748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 2.438s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:03 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-3bb329e1-7c20-414d-a37f-434778213de1 tempest-CreateVolumesFromImageTest-1133715748 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:03 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-3bb329e1-7c20-414d-a37f-434778213de1 tempest-CreateVolumesFromImageTest-1133715748 None] Deleted volume successfully. Jul 08 01:24:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3bb329e1-7c20-414d-a37f-434778213de1 tempest-CreateVolumesFromImageTest-1133715748 None] Lock "cinder-2be0dcbe-f9ce-48b5-9396-8338b87943ce-delete_volume" released by "delete_volume" :: held 4.740s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:04 devstack sudo[105166]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e" returned: 0 in 2.023s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:05 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e Jul 08 01:24:05 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:05 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6" returned: 0 in 2.091s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:05 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0a3d0461-cc04-4dd1-a06c-2559aa148b3d_noxauymidevstack@QuobyteHD, size 0.00 MB, duration 2.10 sec, destination /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6 {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:24:05 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Converted 0.00 MB image at 0.00 MB/s Jul 08 01:24:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:05 devstack sudo[105179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6 1G Jul 08 01:24:05 devstack sudo[105179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:06 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e" returned: 1 in 2.006s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:24:06 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Downloaded image 59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad ((None, [{'url': 'file:///opt/stack/data/glance/images/59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad', 'metadata': {}}])) to volume f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e successfully. {{(pid=87123) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:24:06 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Temporary image 59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad for user 03019562072f45fd940ef0d3c4bf61ac is deleted. {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:24:06 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Marking volume f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e as bootable. {{(pid=87123) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:24:06 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Copying metadata from image 59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad to f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e. {{(pid=87123) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:24:06 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Creating volume glance metadata for volume f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e backed by image 59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad with: {'image_id': '59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '90adcc07843dae9e2e3ab2fd276bc85a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87123) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:24:06 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:06 devstack sudo[105179]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3ef90718-676a-4e61-b8e5-2b25f5f54da9" returned: 0 in 6.609s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6 1G" returned: 0 in 1.651s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:06 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdfbe3f2-0b78-479e-97bb-14a93a6ff6b8]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:06 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0eb1ea-8e11-4f8a-9508-1fc87f948d31]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (047c93eb-9e84-4ec1-9229-6a5e968182da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e', 'volume_size': 1, 'image_id': '59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '90adcc07843dae9e2e3ab2fd276bc85a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'fe72d962edf44b49a5ac0adb6e1fb1bb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '594e5c2a0663213c67f7f00d8d9c3271c6ee057413de24319c10d7af3c1322837a249b0c80a50a19e6b2cb4f177d8f01a547ebef42f935b1c417c64d92cc768c', 'id': '59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad', 'created_at': datetime.datetime(2026, 7, 7, 23, 23, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 23, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/59cb73ff-2671-4bbf-ab7f-be1b4ccbe9ad/file', 'properties': {}}, 'image_service': }' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14359ed4-6791-46f4-8db0-063fd6d45d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:07 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Volume volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e (f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e): created successfully Jul 08 01:24:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14359ed4-6791-46f4-8db0-063fd6d45d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Flow 'volume_create_manager' (885f813c-90af-4374-a180-cc90ec2ff9de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:07 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-5abf86e5-52ec-4fe6-8675-e7463d76457f tempest-VolumeImageDependencyTests-1379789168 None] Created volume successfully. Jul 08 01:24:07 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 Jul 08 01:24:07 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:07 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6 Jul 08 01:24:07 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:07 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6" returned: 0 in 0.832s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:07 devstack sudo[105196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6 Jul 08 01:24:07 devstack sudo[105196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:07 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03" returned: 0 in 1.037s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:07 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Image conversion details: src /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03, size 1024.00 MB, duration 6.61 sec, destination /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3ef90718-676a-4e61-b8e5-2b25f5f54da9 {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:24:07 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Converted 1024.00 MB image at 154.91 MB/s Jul 08 01:24:07 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3ef90718-676a-4e61-b8e5-2b25f5f54da9 is being set with open permissions: ugo+rw Jul 08 01:24:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3ef90718-676a-4e61-b8e5-2b25f5f54da9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:07 devstack sudo[105199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3ef90718-676a-4e61-b8e5-2b25f5f54da9 Jul 08 01:24:07 devstack sudo[105199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] Acquiring lock "cinder-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] Lock "cinder-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] Acquiring lock "cinder-quobyte-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] Lock "cinder-quobyte-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e" acquired by "delete_volume" :: waited 0.027s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Flow 'volume_create_manager' (1b32a607-0a2c-49be-83be-ad421b8a9a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42b6b76-246b-466f-9441-b18510722b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0921d715-8698-4ff1-88ef-695fe728db40]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42b6b76-246b-466f-9441-b18510722b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-824741707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5caf9355-7c80-4708-b0c4-136aa31087fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbd1098da5444c6a2512d69396be445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:08Z,use_quota=True,user_id='397303508f524999bde1c928f67a59a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ecaf55-2731-4bfe-b4b5-5bad706036c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56ecaf55-2731-4bfe-b4b5-5bad706036c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36986199-353d-418c-8643-56cc217e0642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36986199-353d-418c-8643-56cc217e0642) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5caf9355-7c80-4708-b0c4-136aa31087fa', 'volume_name': 'volume-5caf9355-7c80-4708-b0c4-136aa31087fa', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99223a49-ffe4-4c2f-8f17-cefa5a3cfefc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99223a49-ffe4-4c2f-8f17-cefa5a3cfefc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f428c9c7-d2ec-4ccf-96ab-d3bee3b9a666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:08 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Volume 5caf9355-7c80-4708-b0c4-136aa31087fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5caf9355-7c80-4708-b0c4-136aa31087fa', 'volume_size': 1} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:08 devstack sudo[105201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e Jul 08 01:24:08 devstack sudo[105201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:08 devstack sudo[105196]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6" returned: 1 in 0.904s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Downloaded image 0a3d0461-cc04-4dd1-a06c-2559aa148b3d ((None, [{'url': 'file:///opt/stack/data/glance/images/0a3d0461-cc04-4dd1-a06c-2559aa148b3d', 'metadata': {}}])) to volume bbab89e7-61f2-4e74-943c-ad075fa61df6 successfully. {{(pid=87123) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Temporary image 0a3d0461-cc04-4dd1-a06c-2559aa148b3d for user 9c6760a54fa84920976be5c000836568 is deleted. {{(pid=87123) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.volume_utils [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Marking volume bbab89e7-61f2-4e74-943c-ad075fa61df6 as bootable. {{(pid=87123) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Copying metadata from image 0a3d0461-cc04-4dd1-a06c-2559aa148b3d to bbab89e7-61f2-4e74-943c-ad075fa61df6. {{(pid=87123) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Creating volume glance metadata for volume bbab89e7-61f2-4e74-943c-ad075fa61df6 backed by image 0a3d0461-cc04-4dd1-a06c-2559aa148b3d with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0a3d0461-cc04-4dd1-a06c-2559aa148b3d', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a354c48c1085840b34a28cefdbc79881', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87123) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 08 01:24:08 devstack sudo[105199]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3ef90718-676a-4e61-b8e5-2b25f5f54da9" returned: 0 in 0.794s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Lock "cinder-quobyte-3ef90718-676a-4e61-b8e5-2b25f5f54da9" released by "_copy_volume_from_snapshot" :: held 10.584s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Lock "cinder-quobyte-41cb3ae2-27b4-44b9-967e-8bf188945a18-3ef90718-676a-4e61-b8e5-2b25f5f54da9" released by "_create_volume_from_snapshot" :: held 10.638s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.669s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.267s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-824741707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5caf9355-7c80-4708-b0c4-136aa31087fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbd1098da5444c6a2512d69396be445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:08Z,use_quota=True,user_id='397303508f524999bde1c928f67a59a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Creating volume 5caf9355-7c80-4708-b0c4-136aa31087fa {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:24:08 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:08 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa 1073741824 Jul 08 01:24:08 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdfa928c-fc79-493c-827e-b8a0ab728579) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ef90718-676a-4e61-b8e5-2b25f5f54da9', 'volume_size': 1, 'snapshot_id': '41cb3ae2-27b4-44b9-967e-8bf188945a18'}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e0fc93-e2d4-4ced-86c0-11c51f87f25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef473da5-afe0-4a6e-8987-41bfe0025b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbab89e7-61f2-4e74-943c-ad075fa61df6', 'volume_size': 1, 'image_id': '0a3d0461-cc04-4dd1-a06c-2559aa148b3d', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a3d0461-cc04-4dd1-a06c-2559aa148b3d', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a354c48c1085840b34a28cefdbc79881', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'da1ce8c37a9e432bb7a52891ddf63810', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '177f6997e3db5eb021cba3338c97da5697d47029b9bdb2fda85f47f855c20fa02557445beeed183334b52f9f755ca69526e46d04d5b3cbd667321919acf9ea38', 'id': '0a3d0461-cc04-4dd1-a06c-2559aa148b3d', 'created_at': datetime.datetime(2026, 7, 7, 23, 23, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 7, 23, 23, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a3d0461-cc04-4dd1-a06c-2559aa148b3d/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be1d2f3-1590-4d43-a7f9-51c9c2c865d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:08 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Volume volume-3ef90718-676a-4e61-b8e5-2b25f5f54da9 (3ef90718-676a-4e61-b8e5-2b25f5f54da9): created successfully Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5e0fc93-e2d4-4ced-86c0-11c51f87f25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Flow 'volume_create_manager' (1b86145e-6550-4c9a-b7d6-b5c3ea47cc94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:08 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Volume volume-bbab89e7-61f2-4e74-943c-ad075fa61df6 (bbab89e7-61f2-4e74-943c-ad075fa61df6): created successfully Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1be1d2f3-1590-4d43-a7f9-51c9c2c865d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:08 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Flow 'volume_create_manager' (8fe955db-b258-4f1f-95c1-f90c80537cef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:08 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-d6356dba-51b4-4e69-86a5-930caae706c2 tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Created volume successfully. Jul 08 01:24:08 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-15d061f7-b4c4-481c-b47a-5be708413add tempest-VolumeDependencyTests-1686982014 None] Created volume successfully. Jul 08 01:24:09 devstack sudo[105201]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e" returned: 0 in 0.869s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:09 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e Jul 08 01:24:09 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:09 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa 1073741824" returned: 0 in 0.947s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:09 devstack sudo[105216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa Jul 08 01:24:09 devstack sudo[105216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Acquiring lock "cinder-bbab89e7-61f2-4e74-943c-ad075fa61df6-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Lock "cinder-bbab89e7-61f2-4e74-943c-ad075fa61df6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-771d1c0d-7b72-4480-a5a0-8ce85078be14 tempest-VolumeDependencyTests-1686982014 None] Acquiring lock "cinder-41cb3ae2-27b4-44b9-967e-8bf188945a18-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Acquiring lock "cinder-quobyte-bbab89e7-61f2-4e74-943c-ad075fa61df6" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-771d1c0d-7b72-4480-a5a0-8ce85078be14 tempest-VolumeDependencyTests-1686982014 None] Lock "cinder-41cb3ae2-27b4-44b9-967e-8bf188945a18-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-771d1c0d-7b72-4480-a5a0-8ce85078be14 tempest-VolumeDependencyTests-1686982014 None] Acquiring lock "cinder-quobyte-c4e76761-33e7-4657-b000-2fecaf9e8f03" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Lock "cinder-quobyte-bbab89e7-61f2-4e74-943c-ad075fa61df6" acquired by "delete_volume" :: waited 0.039s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-771d1c0d-7b72-4480-a5a0-8ce85078be14 tempest-VolumeDependencyTests-1686982014 None] Lock "cinder-quobyte-c4e76761-33e7-4657-b000-2fecaf9e8f03" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-771d1c0d-7b72-4480-a5a0-8ce85078be14 tempest-VolumeDependencyTests-1686982014 None] Acquiring lock "cinder-quobyte-41cb3ae2-27b4-44b9-967e-8bf188945a18" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-771d1c0d-7b72-4480-a5a0-8ce85078be14 tempest-VolumeDependencyTests-1686982014 None] Lock "cinder-quobyte-41cb3ae2-27b4-44b9-967e-8bf188945a18" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-771d1c0d-7b72-4480-a5a0-8ce85078be14 tempest-VolumeDependencyTests-1686982014 None] Deleting offline snapshot 41cb3ae2-27b4-44b9-967e-8bf188945a18 of volume c4e76761-33e7-4657-b000-2fecaf9e8f03 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-771d1c0d-7b72-4480-a5a0-8ce85078be14 tempest-VolumeDependencyTests-1686982014 None] snapshot_file for this snap is: volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b542c50-ad6d-4b5c-a180-579c5ed7ab22]: (4, 'raw') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:10 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b08ec3-0c0e-4943-a2ff-905e0ab546e1]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-771d1c0d-7b72-4480-a5a0-8ce85078be14 tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e" returned: 1 in 0.899s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:10 devstack sudo[105223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e Jul 08 01:24:10 devstack sudo[105223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:10 devstack sudo[105221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6 Jul 08 01:24:10 devstack sudo[105221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:10 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18 Jul 08 01:24:10 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:10 devstack sudo[105216]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa" returned: 0 in 0.848s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f428c9c7-d2ec-4ccf-96ab-d3bee3b9a666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5caf9355-7c80-4708-b0c4-136aa31087fa', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd8a4713-bed0-4283-ade0-4284f96beed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:10 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Volume volume-5caf9355-7c80-4708-b0c4-136aa31087fa (5caf9355-7c80-4708-b0c4-136aa31087fa): created successfully Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd8a4713-bed0-4283-ade0-4284f96beed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Flow 'volume_create_manager' (1b32a607-0a2c-49be-83be-ad421b8a9a64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:10 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-ab49f623-3fd4-4cc0-8442-298fc43b5431 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Created volume successfully. Jul 08 01:24:10 devstack sudo[105223]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e" returned: 0 in 0.766s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] Lock "cinder-quobyte-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e" released by "delete_volume" :: held 2.606s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:11 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] Created reservations ['c838b09d-d545-43c3-9304-1afe1e9358a7', 'fc4fe5fa-5e77-43ef-89cc-517841f44038', 'fe125870-4eee-4bba-a5c7-e37a877d241c', '2a65ab1d-a02a-4d36-b747-c14aed9a5faa'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:11 devstack sudo[105221]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6" returned: 0 in 0.894s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:11 devstack sudo[105237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:24:11 devstack sudo[105237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:11 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-771d1c0d-7b72-4480-a5a0-8ce85078be14 tempest-VolumeDependencyTests-1686982014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18" returned: 0 in 1.003s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-771d1c0d-7b72-4480-a5a0-8ce85078be14 tempest-VolumeDependencyTests-1686982014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c4e76761-33e7-4657-b000-2fecaf9e8f03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:24:11 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6 Jul 08 01:24:11 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:11 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[8812f6d5-3636-4b3b-b953-119126f10cc5]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-771d1c0d-7b72-4480-a5a0-8ce85078be14 tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:11 devstack sudo[105240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 Jul 08 01:24:11 devstack sudo[105240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0d2f71e0-21f2-40d6-8008-ed30ec7676bc tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0d2f71e0-21f2-40d6-8008-ed30ec7676bc tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-0d2f71e0-21f2-40d6-8008-ed30ec7676bc tempest-CreateVolumesFromSnapshotTest-1074724995 None] Creating offline snapshot 49d4c612-1ff6-428d-8a1f-e51c39aa4a70 of volume 5caf9355-7c80-4708-b0c4-136aa31087fa {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:24:11 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e592d6-8a4d-4967-9e8f-8e50d39afddc]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0d2f71e0-21f2-40d6-8008-ed30ec7676bc tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:12 devstack sudo[105237]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.910s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:12 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:12 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] Deleted volume successfully. Jul 08 01:24:12 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-62f04cda-312b-4175-9692-38e7af139ac8 tempest-VolumeImageDependencyTests-1379789168 None] Lock "cinder-f2a5a7ae-4a0d-4bd2-858d-1f0ee989d73e-delete_volume" released by "delete_volume" :: held 3.839s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:12 devstack sudo[105245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa Jul 08 01:24:12 devstack sudo[105245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:12 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6" returned: 1 in 1.091s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6' failed. Not Retrying. {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 08 01:24:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:12 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6 Jul 08 01:24:12 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:12 devstack sudo[105240]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-771d1c0d-7b72-4480-a5a0-8ce85078be14 tempest-VolumeDependencyTests-1686982014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03" returned: 0 in 0.992s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-771d1c0d-7b72-4480-a5a0-8ce85078be14 tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:12 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18 Jul 08 01:24:12 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:13 devstack sudo[105245]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0d2f71e0-21f2-40d6-8008-ed30ec7676bc tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa" returned: 0 in 1.075s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0d2f71e0-21f2-40d6-8008-ed30ec7676bc tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.49d4c612-1ff6-428d-8a1f-e51c39aa4a70 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:13 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bbab89e7-61f2-4e74-943c-ad075fa61df6" returned: 0 in 0.875s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:13 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.49d4c612-1ff6-428d-8a1f-e51c39aa4a70 1G Jul 08 01:24:13 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Lock "cinder-quobyte-bbab89e7-61f2-4e74-943c-ad075fa61df6" released by "delete_volume" :: held 2.959s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:13 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Created reservations ['f551aebd-7825-411b-b08d-f26b40a2f17c', '5e56715d-772e-4a28-b6dd-8a5cffcc5c3b', 'a3221f64-e248-433c-b641-0ac3fb36fefe', 'e5d347da-4c00-4812-b2b4-90bace5d04f9'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:13 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-771d1c0d-7b72-4480-a5a0-8ce85078be14 tempest-VolumeDependencyTests-1686982014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18" returned: 0 in 0.980s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-771d1c0d-7b72-4480-a5a0-8ce85078be14 tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:13 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18 Jul 08 01:24:13 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:13 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:24:13 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:14 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:14 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-771d1c0d-7b72-4480-a5a0-8ce85078be14 tempest-VolumeDependencyTests-1686982014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03.41cb3ae2-27b4-44b9-967e-8bf188945a18" returned: 0 in 1.164s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.074s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:14 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:14 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Deleted volume successfully. Jul 08 01:24:14 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-771d1c0d-7b72-4480-a5a0-8ce85078be14 tempest-VolumeDependencyTests-1686982014 None] Lock "cinder-quobyte-41cb3ae2-27b4-44b9-967e-8bf188945a18" released by "_delete_snapshot" :: held 4.312s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0d2f71e0-21f2-40d6-8008-ed30ec7676bc tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.49d4c612-1ff6-428d-8a1f-e51c39aa4a70 1G" returned: 0 in 1.454s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0d2f71e0-21f2-40d6-8008-ed30ec7676bc tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5caf9355-7c80-4708-b0c4-136aa31087fa -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.49d4c612-1ff6-428d-8a1f-e51c39aa4a70 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-771d1c0d-7b72-4480-a5a0-8ce85078be14 tempest-VolumeDependencyTests-1686982014 None] Lock "cinder-quobyte-c4e76761-33e7-4657-b000-2fecaf9e8f03" released by "delete_snapshot" :: held 4.357s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c9e0ecc7-b42d-46c0-91cd-28d3a6787dbb tempest-VolumeAndVolumeTypeFromImageTest-320008075 None] Lock "cinder-bbab89e7-61f2-4e74-943c-ad075fa61df6-delete_volume" released by "delete_volume" :: held 4.478s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:14 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5caf9355-7c80-4708-b0c4-136aa31087fa -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.49d4c612-1ff6-428d-8a1f-e51c39aa4a70 Jul 08 01:24:14 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:14 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-771d1c0d-7b72-4480-a5a0-8ce85078be14 tempest-VolumeDependencyTests-1686982014 None] Created reservations ['ba2b2cc4-142c-4ad3-83df-c0184aaa918f', 'eec9db4c-2143-4f7d-82d6-ea4cf8db9910', 'c9a12a5d-1043-40e3-a909-067e8fee2b02', '533b081a-4e47-4047-a240-c60923fd0ab2'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:14 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-771d1c0d-7b72-4480-a5a0-8ce85078be14 tempest-VolumeDependencyTests-1686982014 None] Delete snapshot completed successfully. Jul 08 01:24:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-771d1c0d-7b72-4480-a5a0-8ce85078be14 tempest-VolumeDependencyTests-1686982014 None] Lock "cinder-41cb3ae2-27b4-44b9-967e-8bf188945a18-delete_snapshot" released by "delete_snapshot" :: held 4.576s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:15 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0d2f71e0-21f2-40d6-8008-ed30ec7676bc tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5caf9355-7c80-4708-b0c4-136aa31087fa -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.49d4c612-1ff6-428d-8a1f-e51c39aa4a70" returned: 0 in 0.808s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:15 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-0d2f71e0-21f2-40d6-8008-ed30ec7676bc tempest-CreateVolumesFromSnapshotTest-1074724995 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.49d4c612-1ff6-428d-8a1f-e51c39aa4a70 is being set with open permissions: ugo+rw Jul 08 01:24:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0d2f71e0-21f2-40d6-8008-ed30ec7676bc tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.49d4c612-1ff6-428d-8a1f-e51c39aa4a70 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:15 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.49d4c612-1ff6-428d-8a1f-e51c39aa4a70 Jul 08 01:24:15 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:15 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1dcc1f8e-44f1-4fd7-8179-0ff4d6e8b925 tempest-VolumeDependencyTests-1686982014 None] Acquiring lock "cinder-c4e76761-33e7-4657-b000-2fecaf9e8f03-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:15 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1dcc1f8e-44f1-4fd7-8179-0ff4d6e8b925 tempest-VolumeDependencyTests-1686982014 None] Lock "cinder-c4e76761-33e7-4657-b000-2fecaf9e8f03-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:15 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1dcc1f8e-44f1-4fd7-8179-0ff4d6e8b925 tempest-VolumeDependencyTests-1686982014 None] Acquiring lock "cinder-quobyte-c4e76761-33e7-4657-b000-2fecaf9e8f03" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:15 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1dcc1f8e-44f1-4fd7-8179-0ff4d6e8b925 tempest-VolumeDependencyTests-1686982014 None] Lock "cinder-quobyte-c4e76761-33e7-4657-b000-2fecaf9e8f03" acquired by "delete_volume" :: waited 0.025s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:15 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[2366bbc5-61b0-48dd-b51b-8aedec182ce9]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1dcc1f8e-44f1-4fd7-8179-0ff4d6e8b925 tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:15 devstack sudo[105280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 Jul 08 01:24:15 devstack sudo[105280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:16 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0d2f71e0-21f2-40d6-8008-ed30ec7676bc tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.49d4c612-1ff6-428d-8a1f-e51c39aa4a70" returned: 0 in 0.811s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0d2f71e0-21f2-40d6-8008-ed30ec7676bc tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:16 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.info Jul 08 01:24:16 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:16 devstack sudo[105280]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1dcc1f8e-44f1-4fd7-8179-0ff4d6e8b925 tempest-VolumeDependencyTests-1686982014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03" returned: 0 in 0.924s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1dcc1f8e-44f1-4fd7-8179-0ff4d6e8b925 tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:16 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03 Jul 08 01:24:16 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:16 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0d2f71e0-21f2-40d6-8008-ed30ec7676bc tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.info" returned: 0 in 0.829s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:16 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-0d2f71e0-21f2-40d6-8008-ed30ec7676bc tempest-CreateVolumesFromSnapshotTest-1074724995 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.info is being set with open permissions: ugo+rw Jul 08 01:24:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0d2f71e0-21f2-40d6-8008-ed30ec7676bc tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:17 devstack sudo[105291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.info Jul 08 01:24:17 devstack sudo[105291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945654ab-1364-4088-9d84-c76f02aea153 tempest-ProjectAdminTests-819550117 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6468620300293, 'free_capacity_gb': 1775.6468620300293, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87123) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 08 01:24:17 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1dcc1f8e-44f1-4fd7-8179-0ff4d6e8b925 tempest-VolumeDependencyTests-1686982014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c4e76761-33e7-4657-b000-2fecaf9e8f03" returned: 0 in 0.914s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1dcc1f8e-44f1-4fd7-8179-0ff4d6e8b925 tempest-VolumeDependencyTests-1686982014 None] Lock "cinder-quobyte-c4e76761-33e7-4657-b000-2fecaf9e8f03" released by "delete_volume" :: held 1.920s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:17 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-1dcc1f8e-44f1-4fd7-8179-0ff4d6e8b925 tempest-VolumeDependencyTests-1686982014 None] Created reservations ['7da20d14-27b3-479f-b277-7ac89e573bda', '514af32f-68f7-4e32-a89e-4c4b04da7fc5', '0af324c4-c613-4c46-8f22-98d42c396b37', '474cec3e-7905-4a04-b15c-44b7e84bcefa'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1dcc1f8e-44f1-4fd7-8179-0ff4d6e8b925 tempest-VolumeDependencyTests-1686982014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1dcc1f8e-44f1-4fd7-8179-0ff4d6e8b925 tempest-VolumeDependencyTests-1686982014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1dcc1f8e-44f1-4fd7-8179-0ff4d6e8b925 tempest-VolumeDependencyTests-1686982014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1dcc1f8e-44f1-4fd7-8179-0ff4d6e8b925 tempest-VolumeDependencyTests-1686982014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1dcc1f8e-44f1-4fd7-8179-0ff4d6e8b925 tempest-VolumeDependencyTests-1686982014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1dcc1f8e-44f1-4fd7-8179-0ff4d6e8b925 tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:17 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:24:17 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:17 devstack sudo[105291]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0d2f71e0-21f2-40d6-8008-ed30ec7676bc tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.info" returned: 0 in 0.848s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0d2f71e0-21f2-40d6-8008-ed30ec7676bc tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-361498c6-0404-4509-bac0-1db13c59b181 tempest-VolumeDependencyTests-1686982014 None] Acquiring lock "cinder-3ef90718-676a-4e61-b8e5-2b25f5f54da9-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-361498c6-0404-4509-bac0-1db13c59b181 tempest-VolumeDependencyTests-1686982014 None] Lock "cinder-3ef90718-676a-4e61-b8e5-2b25f5f54da9-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:17 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-0d2f71e0-21f2-40d6-8008-ed30ec7676bc tempest-CreateVolumesFromSnapshotTest-1074724995 None] Create snapshot completed successfully Jul 08 01:24:17 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-361498c6-0404-4509-bac0-1db13c59b181 tempest-VolumeDependencyTests-1686982014 None] Acquiring lock "cinder-quobyte-3ef90718-676a-4e61-b8e5-2b25f5f54da9" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:18 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-361498c6-0404-4509-bac0-1db13c59b181 tempest-VolumeDependencyTests-1686982014 None] Lock "cinder-quobyte-3ef90718-676a-4e61-b8e5-2b25f5f54da9" acquired by "delete_volume" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:18 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e94bbca-790a-4962-be21-cb21a077f696]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-361498c6-0404-4509-bac0-1db13c59b181 tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3ef90718-676a-4e61-b8e5-2b25f5f54da9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:18 devstack sudo[105297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3ef90718-676a-4e61-b8e5-2b25f5f54da9 Jul 08 01:24:18 devstack sudo[105297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:18 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1dcc1f8e-44f1-4fd7-8179-0ff4d6e8b925 tempest-VolumeDependencyTests-1686982014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.029s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:18 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-1dcc1f8e-44f1-4fd7-8179-0ff4d6e8b925 tempest-VolumeDependencyTests-1686982014 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:18 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-1dcc1f8e-44f1-4fd7-8179-0ff4d6e8b925 tempest-VolumeDependencyTests-1686982014 None] Deleted volume successfully. Jul 08 01:24:18 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1dcc1f8e-44f1-4fd7-8179-0ff4d6e8b925 tempest-VolumeDependencyTests-1686982014 None] Lock "cinder-c4e76761-33e7-4657-b000-2fecaf9e8f03-delete_volume" released by "delete_volume" :: held 3.241s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:19 devstack sudo[105297]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Flow 'volume_create_manager' (19ef5ce6-cb64-488f-ac56-676f81a93e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852d4732-419d-45c6-a04f-ad4ee4aa1cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-361498c6-0404-4509-bac0-1db13c59b181 tempest-VolumeDependencyTests-1686982014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3ef90718-676a-4e61-b8e5-2b25f5f54da9" returned: 0 in 1.156s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-361498c6-0404-4509-bac0-1db13c59b181 tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3ef90718-676a-4e61-b8e5-2b25f5f54da9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852d4732-419d-45c6-a04f-ad4ee4aa1cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1008846872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47e2c20-176d-44d4-82e0-b7718167ca19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbd1098da5444c6a2512d69396be445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:19Z,use_quota=True,user_id='397303508f524999bde1c928f67a59a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e601af-1923-499b-b7dc-7d52bf6afe8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38e601af-1923-499b-b7dc-7d52bf6afe8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f477c49c-8cee-41a3-afc5-f884c34f5c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f477c49c-8cee-41a3-afc5-f884c34f5c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e47e2c20-176d-44d4-82e0-b7718167ca19', 'volume_name': 'volume-e47e2c20-176d-44d4-82e0-b7718167ca19', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:19 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3ef90718-676a-4e61-b8e5-2b25f5f54da9 Jul 08 01:24:19 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e29dfa-9d23-4f0b-8ca6-4d5be61dbefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1e29dfa-9d23-4f0b-8ca6-4d5be61dbefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37672417-e072-41a7-b3f1-ff1dd1ec9c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:19 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Volume e47e2c20-176d-44d4-82e0-b7718167ca19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e47e2c20-176d-44d4-82e0-b7718167ca19', 'volume_size': 1} Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1008846872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e47e2c20-176d-44d4-82e0-b7718167ca19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbd1098da5444c6a2512d69396be445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:19Z,use_quota=True,user_id='397303508f524999bde1c928f67a59a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Creating volume e47e2c20-176d-44d4-82e0-b7718167ca19 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:24:19 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e47e2c20-176d-44d4-82e0-b7718167ca19 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:19 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e47e2c20-176d-44d4-82e0-b7718167ca19 1073741824 Jul 08 01:24:19 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:19 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:24:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Flow 'volume_create_manager' (ed5bf327-6555-4360-99fb-e53ee19ac434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d067e7ec-a005-4f0e-b45c-32d80ddc559d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d067e7ec-a005-4f0e-b45c-32d80ddc559d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-505317200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d8812a5-00c5-42af-a693-473f027802a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbd1098da5444c6a2512d69396be445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:20Z,use_quota=True,user_id='397303508f524999bde1c928f67a59a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c3c5a6-dc7a-41c1-860e-8b0fde5fda6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43c3c5a6-dc7a-41c1-860e-8b0fde5fda6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b172fd-0a96-4a1a-902a-baa9e8a94413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b172fd-0a96-4a1a-902a-baa9e8a94413) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d8812a5-00c5-42af-a693-473f027802a5', 'volume_name': 'volume-4d8812a5-00c5-42af-a693-473f027802a5', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4e302a-2ed5-4f24-91af-203c257c8ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4e302a-2ed5-4f24-91af-203c257c8ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e481c1e8-c7a2-44bd-9513-139e6e943883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:20 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Volume 4d8812a5-00c5-42af-a693-473f027802a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d8812a5-00c5-42af-a693-473f027802a5', 'volume_size': 1} Jul 08 01:24:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:20 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-361498c6-0404-4509-bac0-1db13c59b181 tempest-VolumeDependencyTests-1686982014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3ef90718-676a-4e61-b8e5-2b25f5f54da9" returned: 0 in 1.510s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-361498c6-0404-4509-bac0-1db13c59b181 tempest-VolumeDependencyTests-1686982014 None] Lock "cinder-quobyte-3ef90718-676a-4e61-b8e5-2b25f5f54da9" released by "delete_volume" :: held 2.739s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:20 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e47e2c20-176d-44d4-82e0-b7718167ca19 1073741824" returned: 0 in 1.506s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:20 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:24:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Flow 'volume_create_manager' (7378ae99-77f9-47f4-93b4-182465440423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:20 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ca05a8-0ff4-434e-a8b3-8c266718691d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e47e2c20-176d-44d4-82e0-b7718167ca19 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5ca05a8-0ff4-434e-a8b3-8c266718691d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1151745333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16f773a-3b0e-4127-b79e-2aa5dc02c7ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbd1098da5444c6a2512d69396be445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:21Z,use_quota=True,user_id='397303508f524999bde1c928f67a59a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68fc0a40-7e83-4e21-807b-752d4b001cd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68fc0a40-7e83-4e21-807b-752d4b001cd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e879e5bc-158d-4b6c-b441-c3d117f5dee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:21 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e47e2c20-176d-44d4-82e0-b7718167ca19 Jul 08 01:24:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e879e5bc-158d-4b6c-b441-c3d117f5dee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b16f773a-3b0e-4127-b79e-2aa5dc02c7ce', 'volume_name': 'volume-b16f773a-3b0e-4127-b79e-2aa5dc02c7ce', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:21 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fb71d8-e58d-4dca-a131-d0de5182be9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8fb71d8-e58d-4dca-a131-d0de5182be9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:21 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875dc9ce-04c6-4d2b-a3a0-ec73b4c056b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:21 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Volume b16f773a-3b0e-4127-b79e-2aa5dc02c7ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b16f773a-3b0e-4127-b79e-2aa5dc02c7ce', 'volume_size': 1} Jul 08 01:24:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:21 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-361498c6-0404-4509-bac0-1db13c59b181 tempest-VolumeDependencyTests-1686982014 None] Created reservations ['1f862aab-d7c1-4955-86ba-3131321eb366', 'd88595c3-4437-4737-89a0-db69906ec37a', '008bfb57-454c-478f-b6c3-ec6a11ca985b', 'e5679072-0a82-4146-b3b3-c9b6ce46c3fc'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-361498c6-0404-4509-bac0-1db13c59b181 tempest-VolumeDependencyTests-1686982014 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-361498c6-0404-4509-bac0-1db13c59b181 tempest-VolumeDependencyTests-1686982014 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-361498c6-0404-4509-bac0-1db13c59b181 tempest-VolumeDependencyTests-1686982014 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-361498c6-0404-4509-bac0-1db13c59b181 tempest-VolumeDependencyTests-1686982014 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-361498c6-0404-4509-bac0-1db13c59b181 tempest-VolumeDependencyTests-1686982014 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-361498c6-0404-4509-bac0-1db13c59b181 tempest-VolumeDependencyTests-1686982014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:21 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:24:21 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:22 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:22 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e47e2c20-176d-44d4-82e0-b7718167ca19" returned: 0 in 1.189s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] <== create_volume: return (2893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.896s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-361498c6-0404-4509-bac0-1db13c59b181 tempest-VolumeDependencyTests-1686982014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.893s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.953s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-505317200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d8812a5-00c5-42af-a693-473f027802a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbd1098da5444c6a2512d69396be445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:20Z,use_quota=True,user_id='397303508f524999bde1c928f67a59a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Creating volume 4d8812a5-00c5-42af-a693-473f027802a5 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:24:22 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4d8812a5-00c5-42af-a693-473f027802a5 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-361498c6-0404-4509-bac0-1db13c59b181 tempest-VolumeDependencyTests-1686982014 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:22 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-361498c6-0404-4509-bac0-1db13c59b181 tempest-VolumeDependencyTests-1686982014 None] Deleted volume successfully. Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:24:22 devstack sudo[105364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4d8812a5-00c5-42af-a693-473f027802a5 1073741824 Jul 08 01:24:22 devstack sudo[105364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Flow 'volume_create_manager' (c68deecc-be47-4c43-ae6d-d257b7a2c206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693ef431-820b-4d1d-83e3-c7c6294c4415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37672417-e072-41a7-b3f1-ff1dd1ec9c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e47e2c20-176d-44d4-82e0-b7718167ca19', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c609dd-32cb-4317-a6ce-cb44a11281b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (693ef431-820b-4d1d-83e3-c7c6294c4415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1176514352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1ec317-c0de-4413-b5b9-1140f361fbdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbd1098da5444c6a2512d69396be445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:22Z,use_quota=True,user_id='397303508f524999bde1c928f67a59a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61db5123-b4b5-4d2f-a08f-ed9e6da7371d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61db5123-b4b5-4d2f-a08f-ed9e6da7371d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a673c23e-2259-43bb-8a9b-72d75a779652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a673c23e-2259-43bb-8a9b-72d75a779652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a1ec317-c0de-4413-b5b9-1140f361fbdf', 'volume_name': 'volume-9a1ec317-c0de-4413-b5b9-1140f361fbdf', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47e907b-a668-40f1-a5c6-75169bcd5c1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47e907b-a668-40f1-a5c6-75169bcd5c1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eca8418-0c22-4b9b-90df-aa0b1cbfb672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:22 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Volume 9a1ec317-c0de-4413-b5b9-1140f361fbdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a1ec317-c0de-4413-b5b9-1140f361fbdf', 'volume_size': 1} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-361498c6-0404-4509-bac0-1db13c59b181 tempest-VolumeDependencyTests-1686982014 None] Lock "cinder-3ef90718-676a-4e61-b8e5-2b25f5f54da9-delete_volume" released by "delete_volume" :: held 4.459s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:22 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Volume volume-e47e2c20-176d-44d4-82e0-b7718167ca19 (e47e2c20-176d-44d4-82e0-b7718167ca19): created successfully Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60c609dd-32cb-4317-a6ce-cb44a11281b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Flow 'volume_create_manager' (19ef5ce6-cb64-488f-ac56-676f81a93e66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:22 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-74001e4d-f139-4240-bfb5-be1fe79d8eb3 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Created volume successfully. Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Flow 'volume_create_manager' (446fd3a7-c3e5-4661-8232-fc88f379aa43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0015bb58-afb3-46b2-939c-24949de11eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Flow 'volume_create_manager' (83f2091f-82c2-4010-a598-eb1615d8b44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26247ce-53f4-4f00-a96a-7b53bec82089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0015bb58-afb3-46b2-939c-24949de11eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1165064343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00725db2-701d-4a9e-94b7-6856b1234b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efbc88703c94f9499ffa74854b55244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:22Z,use_quota=True,user_id='5d1460445eba4ec68c0d237f9597422b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d729b1-c64c-400f-a77f-a7e9b50bba4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42d729b1-c64c-400f-a77f-a7e9b50bba4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d0676f-3380-4285-a637-4c3c18d7c782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02d0676f-3380-4285-a637-4c3c18d7c782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00725db2-701d-4a9e-94b7-6856b1234b95', 'volume_name': 'volume-00725db2-701d-4a9e-94b7-6856b1234b95', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278684a6-625d-4e0b-b858-52787f2ccd98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (278684a6-625d-4e0b-b858-52787f2ccd98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b4e0e0-637c-428f-bbee-c8e1249b8682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:22 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Volume 00725db2-701d-4a9e-94b7-6856b1234b95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00725db2-701d-4a9e-94b7-6856b1234b95', 'volume_size': 1} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d26247ce-53f4-4f00-a96a-7b53bec82089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1451712736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d11d9e-d420-4253-ab3a-2c7a57d4a6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbd1098da5444c6a2512d69396be445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:22Z,use_quota=True,user_id='397303508f524999bde1c928f67a59a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1a6f67-0e19-4cb8-9d37-989165563384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af1a6f67-0e19-4cb8-9d37-989165563384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e2a13d3-3ff6-4585-99b1-9f0f10ef2196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e2a13d3-3ff6-4585-99b1-9f0f10ef2196) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58d11d9e-d420-4253-ab3a-2c7a57d4a6cc', 'volume_name': 'volume-58d11d9e-d420-4253-ab3a-2c7a57d4a6cc', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569a4e03-8e7d-4256-9651-f498b96d339c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (569a4e03-8e7d-4256-9651-f498b96d339c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da6a928-cc2b-4f5a-af5b-5ce27f35b3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:22 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Volume 58d11d9e-d420-4253-ab3a-2c7a57d4a6cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58d11d9e-d420-4253-ab3a-2c7a57d4a6cc', 'volume_size': 1} Jul 08 01:24:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:23 devstack sudo[105364]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4d8812a5-00c5-42af-a693-473f027802a5 1073741824" returned: 0 in 1.154s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4d8812a5-00c5-42af-a693-473f027802a5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:23 devstack sudo[105370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4d8812a5-00c5-42af-a693-473f027802a5 Jul 08 01:24:23 devstack sudo[105370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:24 devstack sudo[105370]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4d8812a5-00c5-42af-a693-473f027802a5" returned: 0 in 0.778s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] <== create_volume: return (1985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:24:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.989s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.108s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1151745333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16f773a-3b0e-4127-b79e-2aa5dc02c7ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbd1098da5444c6a2512d69396be445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:21Z,use_quota=True,user_id='397303508f524999bde1c928f67a59a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:24:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Creating volume b16f773a-3b0e-4127-b79e-2aa5dc02c7ce {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:24:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:24:24 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:24:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b16f773a-3b0e-4127-b79e-2aa5dc02c7ce 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e481c1e8-c7a2-44bd-9513-139e6e943883) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d8812a5-00c5-42af-a693-473f027802a5', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:24 devstack sudo[105373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b16f773a-3b0e-4127-b79e-2aa5dc02c7ce 1073741824 Jul 08 01:24:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62690022-2244-423f-a0ac-66b277b4cccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:24 devstack sudo[105373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:24 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Volume volume-4d8812a5-00c5-42af-a693-473f027802a5 (4d8812a5-00c5-42af-a693-473f027802a5): created successfully Jul 08 01:24:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (62690022-2244-423f-a0ac-66b277b4cccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Flow 'volume_create_manager' (ed5bf327-6555-4360-99fb-e53ee19ac434) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:24 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-1c7dfc5e-2006-4d19-b554-e37ec00262fb tempest-CreateVolumesFromSnapshotTest-1074724995 None] Created volume successfully. Jul 08 01:24:25 devstack sudo[105373]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b16f773a-3b0e-4127-b79e-2aa5dc02c7ce 1073741824" returned: 0 in 0.886s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b16f773a-3b0e-4127-b79e-2aa5dc02c7ce {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:25 devstack sudo[105378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b16f773a-3b0e-4127-b79e-2aa5dc02c7ce Jul 08 01:24:25 devstack sudo[105378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:25 devstack sudo[105378]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b16f773a-3b0e-4127-b79e-2aa5dc02c7ce" returned: 0 in 0.792s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:24:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.728s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.506s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1176514352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1ec317-c0de-4413-b5b9-1140f361fbdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbd1098da5444c6a2512d69396be445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:22Z,use_quota=True,user_id='397303508f524999bde1c928f67a59a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:24:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Creating volume 9a1ec317-c0de-4413-b5b9-1140f361fbdf {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:24:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:24:25 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:24:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a1ec317-c0de-4413-b5b9-1140f361fbdf 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:25 devstack sudo[105381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a1ec317-c0de-4413-b5b9-1140f361fbdf 1073741824 Jul 08 01:24:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (875dc9ce-04c6-4d2b-a3a0-ec73b4c056b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b16f773a-3b0e-4127-b79e-2aa5dc02c7ce', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:25 devstack sudo[105381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ae5d70-4a41-4e07-9232-7a8662972145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:25 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Volume volume-b16f773a-3b0e-4127-b79e-2aa5dc02c7ce (b16f773a-3b0e-4127-b79e-2aa5dc02c7ce): created successfully Jul 08 01:24:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ae5d70-4a41-4e07-9232-7a8662972145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Flow 'volume_create_manager' (7378ae99-77f9-47f4-93b4-182465440423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:25 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-5673bff6-7219-4890-ae4e-7db5ce095401 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Created volume successfully. Jul 08 01:24:26 devstack sudo[105381]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a1ec317-c0de-4413-b5b9-1140f361fbdf 1073741824" returned: 0 in 0.987s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a1ec317-c0de-4413-b5b9-1140f361fbdf {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:26 devstack sudo[105386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a1ec317-c0de-4413-b5b9-1140f361fbdf Jul 08 01:24:26 devstack sudo[105386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:27 devstack sudo[105386]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a1ec317-c0de-4413-b5b9-1140f361fbdf" returned: 0 in 0.747s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:24:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.778s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.061s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1165064343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00725db2-701d-4a9e-94b7-6856b1234b95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efbc88703c94f9499ffa74854b55244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:22Z,use_quota=True,user_id='5d1460445eba4ec68c0d237f9597422b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:24:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Creating volume 00725db2-701d-4a9e-94b7-6856b1234b95 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:24:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:24:27 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:24:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-00725db2-701d-4a9e-94b7-6856b1234b95 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:27 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-00725db2-701d-4a9e-94b7-6856b1234b95 1073741824 Jul 08 01:24:27 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eca8418-0c22-4b9b-90df-aa0b1cbfb672) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a1ec317-c0de-4413-b5b9-1140f361fbdf', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97724977-4ab9-440c-a073-0d88003c47bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:27 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Volume volume-9a1ec317-c0de-4413-b5b9-1140f361fbdf (9a1ec317-c0de-4413-b5b9-1140f361fbdf): created successfully Jul 08 01:24:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97724977-4ab9-440c-a073-0d88003c47bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Flow 'volume_create_manager' (c68deecc-be47-4c43-ae6d-d257b7a2c206) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:27 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-6ccf0282-0a6f-498d-835f-832139680756 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Created volume successfully. Jul 08 01:24:28 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-00725db2-701d-4a9e-94b7-6856b1234b95 1073741824" returned: 0 in 1.109s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-00725db2-701d-4a9e-94b7-6856b1234b95 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:28 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-00725db2-701d-4a9e-94b7-6856b1234b95 Jul 08 01:24:28 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:29 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-00725db2-701d-4a9e-94b7-6856b1234b95" returned: 0 in 0.698s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:29 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] <== create_volume: return (1855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:24:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.871s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:29 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1451712736',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58d11d9e-d420-4253-ab3a-2c7a57d4a6cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ddbd1098da5444c6a2512d69396be445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:22Z,use_quota=True,user_id='397303508f524999bde1c928f67a59a6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:24:29 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Creating volume 58d11d9e-d420-4253-ab3a-2c7a57d4a6cc {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:24:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:29 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:29 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:29 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:24:29 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:24:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-58d11d9e-d420-4253-ab3a-2c7a57d4a6cc 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:29 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87b4e0e0-637c-428f-bbee-c8e1249b8682) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00725db2-701d-4a9e-94b7-6856b1234b95', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:29 devstack sudo[105398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-58d11d9e-d420-4253-ab3a-2c7a57d4a6cc 1073741824 Jul 08 01:24:29 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d35e055-c9be-45d8-97de-8e2c7bed3985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:29 devstack sudo[105398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:29 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Volume volume-00725db2-701d-4a9e-94b7-6856b1234b95 (00725db2-701d-4a9e-94b7-6856b1234b95): created successfully Jul 08 01:24:29 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d35e055-c9be-45d8-97de-8e2c7bed3985) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:29 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Flow 'volume_create_manager' (446fd3a7-c3e5-4661-8232-fc88f379aa43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:29 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-945c3979-bd4a-4bf1-8d32-c95adedf71fc tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Created volume successfully. Jul 08 01:24:30 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:24:30 devstack sudo[105398]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Flow 'volume_create_manager' (e9eaaa46-3469-4c9d-8b0b-15d575d92c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f68e911-c031-4d91-868b-9f0d1434147a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-58d11d9e-d420-4253-ab3a-2c7a57d4a6cc 1073741824" returned: 0 in 1.345s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f68e911-c031-4d91-868b-9f0d1434147a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1982297514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=528a9ae2-42ac-41fe-80e0-224c38c12ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efbc88703c94f9499ffa74854b55244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:31Z,use_quota=True,user_id='5d1460445eba4ec68c0d237f9597422b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9bd8cc-660a-431c-8367-1e3c3835f2c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9bd8cc-660a-431c-8367-1e3c3835f2c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b743f777-7af4-4d61-ab9f-f7b90fc09a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b743f777-7af4-4d61-ab9f-f7b90fc09a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '528a9ae2-42ac-41fe-80e0-224c38c12ffa', 'volume_name': 'volume-528a9ae2-42ac-41fe-80e0-224c38c12ffa', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8284cc34-7d70-4074-be49-98c67dbd49b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8284cc34-7d70-4074-be49-98c67dbd49b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1471d1-70b2-4127-b61f-0f778f9ceb97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:31 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Volume 528a9ae2-42ac-41fe-80e0-224c38c12ffa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-528a9ae2-42ac-41fe-80e0-224c38c12ffa', 'volume_size': 1} Jul 08 01:24:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-58d11d9e-d420-4253-ab3a-2c7a57d4a6cc {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:31 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-58d11d9e-d420-4253-ab3a-2c7a57d4a6cc Jul 08 01:24:31 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:31 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:24:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Flow 'volume_create_manager' (3b071ef9-93b8-4885-9c34-06ccba2f9248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5369981-e816-43f9-a398-378df8a3196a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5369981-e816-43f9-a398-378df8a3196a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1881392387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e02d0b-8537-429b-8473-707be770f8e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efbc88703c94f9499ffa74854b55244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:31Z,use_quota=True,user_id='5d1460445eba4ec68c0d237f9597422b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ffa5955-3846-4431-ab9b-0ec52dd0d6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ffa5955-3846-4431-ab9b-0ec52dd0d6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48db66cc-f98d-443e-bae8-b184f0859e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48db66cc-f98d-443e-bae8-b184f0859e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76e02d0b-8537-429b-8473-707be770f8e7', 'volume_name': 'volume-76e02d0b-8537-429b-8473-707be770f8e7', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59eae087-00ab-4415-8f2c-9f9dfeef3765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59eae087-00ab-4415-8f2c-9f9dfeef3765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133fae89-a383-48c4-bc38-53eee8c9915d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:31 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Volume 76e02d0b-8537-429b-8473-707be770f8e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76e02d0b-8537-429b-8473-707be770f8e7', 'volume_size': 1} Jul 08 01:24:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:31 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:24:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Flow 'volume_create_manager' (08c947a5-8662-4b04-bb6d-cf0cd3f7166a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ea4181-1d63-4f56-8a3d-b28bd7b367cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (94ea4181-1d63-4f56-8a3d-b28bd7b367cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1776514149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efbc88703c94f9499ffa74854b55244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:32Z,use_quota=True,user_id='5d1460445eba4ec68c0d237f9597422b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ad98ca-5725-4db3-8e41-9cb6661e58bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8ad98ca-5725-4db3-8e41-9cb6661e58bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6303f6ba-9a4d-428a-88fa-2ab4e7ff5a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6303f6ba-9a4d-428a-88fa-2ab4e7ff5a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c', 'volume_name': 'volume-9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1652ae7-9384-4dbf-91d9-1b24486e65f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1652ae7-9384-4dbf-91d9-1b24486e65f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc43eac8-d014-4ca2-8572-95c94889c22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:32 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Volume 9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c', 'volume_size': 1} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:32 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-58d11d9e-d420-4253-ab3a-2c7a57d4a6cc" returned: 0 in 1.064s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] <== create_volume: return (2593ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.597s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.131s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1982297514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=528a9ae2-42ac-41fe-80e0-224c38c12ffa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efbc88703c94f9499ffa74854b55244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:31Z,use_quota=True,user_id='5d1460445eba4ec68c0d237f9597422b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Creating volume 528a9ae2-42ac-41fe-80e0-224c38c12ffa {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:24:32 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-528a9ae2-42ac-41fe-80e0-224c38c12ffa 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:32 devstack sudo[105410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-528a9ae2-42ac-41fe-80e0-224c38c12ffa 1073741824 Jul 08 01:24:32 devstack sudo[105410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1da6a928-cc2b-4f5a-af5b-5ce27f35b3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58d11d9e-d420-4253-ab3a-2c7a57d4a6cc', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fec634-e743-4127-8ef1-93499b575594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:32 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Volume volume-58d11d9e-d420-4253-ab3a-2c7a57d4a6cc (58d11d9e-d420-4253-ab3a-2c7a57d4a6cc): created successfully Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fec634-e743-4127-8ef1-93499b575594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Flow 'volume_create_manager' (83f2091f-82c2-4010-a598-eb1615d8b44e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:32 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-13bd369c-a5f0-42e9-9095-d3f8e82ec6a9 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Created volume successfully. Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8766e858-554d-4f20-b903-33d285136c91 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "cinder-58d11d9e-d420-4253-ab3a-2c7a57d4a6cc-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8766e858-554d-4f20-b903-33d285136c91 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-58d11d9e-d420-4253-ab3a-2c7a57d4a6cc-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8766e858-554d-4f20-b903-33d285136c91 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "cinder-quobyte-58d11d9e-d420-4253-ab3a-2c7a57d4a6cc" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8766e858-554d-4f20-b903-33d285136c91 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-quobyte-58d11d9e-d420-4253-ab3a-2c7a57d4a6cc" acquired by "delete_volume" :: waited 0.024s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6673752-e091-4812-adf4-6a5b23d38a56]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8766e858-554d-4f20-b903-33d285136c91 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-58d11d9e-d420-4253-ab3a-2c7a57d4a6cc {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:32 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-58d11d9e-d420-4253-ab3a-2c7a57d4a6cc Jul 08 01:24:32 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Flow 'volume_create_manager' (c99f8fd4-166a-462a-bc47-b83e6364dc5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7b8d4d-007a-46c2-999d-1b13367e8c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7b8d4d-007a-46c2-999d-1b13367e8c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-565821899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2bfb7d9-641f-43fe-b190-8bad030744e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efbc88703c94f9499ffa74854b55244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:33Z,use_quota=True,user_id='5d1460445eba4ec68c0d237f9597422b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65b74db-9e25-4fe5-8d5c-7a041811dc0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f65b74db-9e25-4fe5-8d5c-7a041811dc0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3080c7a3-ac2a-4c82-a517-3ffd3078d07a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3080c7a3-ac2a-4c82-a517-3ffd3078d07a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2bfb7d9-641f-43fe-b190-8bad030744e8', 'volume_name': 'volume-a2bfb7d9-641f-43fe-b190-8bad030744e8', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2eb2885-4763-4fe4-9825-296683264a90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2eb2885-4763-4fe4-9825-296683264a90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605cf411-5738-4f36-8ac4-3d20bfc94493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:33 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Volume a2bfb7d9-641f-43fe-b190-8bad030744e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2bfb7d9-641f-43fe-b190-8bad030744e8', 'volume_size': 1} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Flow 'volume_create_manager' (587bc7ae-dabd-4fc0-a81e-91061fb27506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e8e643-f861-4105-8925-e5ce90acb50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e8e643-f861-4105-8925-e5ce90acb50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-40439118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26a7e3a6-8f91-4fba-b916-bb782b4cd4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efbc88703c94f9499ffa74854b55244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:33Z,use_quota=True,user_id='5d1460445eba4ec68c0d237f9597422b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28e9682-dbbb-4944-ae4d-16bd7d217851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c28e9682-dbbb-4944-ae4d-16bd7d217851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92068c4-9e74-4345-b8f1-fb3f469b20ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e92068c4-9e74-4345-b8f1-fb3f469b20ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26a7e3a6-8f91-4fba-b916-bb782b4cd4fc', 'volume_name': 'volume-26a7e3a6-8f91-4fba-b916-bb782b4cd4fc', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87959fe-ec94-4695-b917-d9ddf8a8cc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f87959fe-ec94-4695-b917-d9ddf8a8cc7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2167a0cf-7950-4cf9-a1c9-e433c98477e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:33 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Volume 26a7e3a6-8f91-4fba-b916-bb782b4cd4fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26a7e3a6-8f91-4fba-b916-bb782b4cd4fc', 'volume_size': 1} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:33 devstack sudo[105410]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-528a9ae2-42ac-41fe-80e0-224c38c12ffa 1073741824" returned: 0 in 1.627s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-528a9ae2-42ac-41fe-80e0-224c38c12ffa {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:33 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-528a9ae2-42ac-41fe-80e0-224c38c12ffa Jul 08 01:24:33 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:33 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8766e858-554d-4f20-b903-33d285136c91 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-58d11d9e-d420-4253-ab3a-2c7a57d4a6cc" returned: 0 in 1.113s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8766e858-554d-4f20-b903-33d285136c91 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-58d11d9e-d420-4253-ab3a-2c7a57d4a6cc {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:33 devstack sudo[105424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-58d11d9e-d420-4253-ab3a-2c7a57d4a6cc Jul 08 01:24:33 devstack sudo[105424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:34 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-528a9ae2-42ac-41fe-80e0-224c38c12ffa" returned: 0 in 0.817s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] <== create_volume: return (2496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.500s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.140s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1881392387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76e02d0b-8537-429b-8473-707be770f8e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efbc88703c94f9499ffa74854b55244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:31Z,use_quota=True,user_id='5d1460445eba4ec68c0d237f9597422b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Creating volume 76e02d0b-8537-429b-8473-707be770f8e7 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:24:34 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76e02d0b-8537-429b-8473-707be770f8e7 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:34 devstack sudo[105428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76e02d0b-8537-429b-8473-707be770f8e7 1073741824 Jul 08 01:24:34 devstack sudo[105428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b1471d1-70b2-4127-b61f-0f778f9ceb97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-528a9ae2-42ac-41fe-80e0-224c38c12ffa', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aca6ca9-3ca0-4a22-95bb-5c867ebd4f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:34 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Volume volume-528a9ae2-42ac-41fe-80e0-224c38c12ffa (528a9ae2-42ac-41fe-80e0-224c38c12ffa): created successfully Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aca6ca9-3ca0-4a22-95bb-5c867ebd4f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Flow 'volume_create_manager' (e9eaaa46-3469-4c9d-8b0b-15d575d92c8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:34 devstack sudo[105424]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8766e858-554d-4f20-b903-33d285136c91 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-58d11d9e-d420-4253-ab3a-2c7a57d4a6cc" returned: 0 in 0.910s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:34 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-45531900-3f8d-4b73-af98-b8d98781d1db tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Created volume successfully. Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8766e858-554d-4f20-b903-33d285136c91 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-quobyte-58d11d9e-d420-4253-ab3a-2c7a57d4a6cc" released by "delete_volume" :: held 2.105s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-8766e858-554d-4f20-b903-33d285136c91 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Created reservations ['84e3baa1-a2ad-4b83-a029-a935e359638a', '56b3a54a-546e-4c48-8d1c-cec2afea77ac', '8e97809f-db88-401d-93d2-c5dfab01827e', '88505d33-b813-4c91-84b6-3eb9c3b604fa'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8766e858-554d-4f20-b903-33d285136c91 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8766e858-554d-4f20-b903-33d285136c91 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-8766e858-554d-4f20-b903-33d285136c91 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:35 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-8766e858-554d-4f20-b903-33d285136c91 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8766e858-554d-4f20-b903-33d285136c91 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8766e858-554d-4f20-b903-33d285136c91 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:35 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:24:35 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:35 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:24:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Flow 'volume_create_manager' (85ad21d1-189d-47a7-a81e-43884befd869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db17e582-0197-4c56-8d3e-b9c65904186c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db17e582-0197-4c56-8d3e-b9c65904186c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-549136345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c0e166-0933-4eb0-bbdd-0a13083795fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b494986802e847a4affb97c98aa065de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:35Z,use_quota=True,user_id='623652f2428c42bfa392b84db656aa0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8554277-a543-4a1e-8915-22a4a8841f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8554277-a543-4a1e-8915-22a4a8841f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dcbbcce-7a12-4a5c-86f1-b7d38686b80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dcbbcce-7a12-4a5c-86f1-b7d38686b80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8c0e166-0933-4eb0-bbdd-0a13083795fc', 'volume_name': 'volume-c8c0e166-0933-4eb0-bbdd-0a13083795fc', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a240cfdd-ad05-4b14-888f-62253865f5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a240cfdd-ad05-4b14-888f-62253865f5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:35 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef793b7-c4f1-4813-880f-75711732d587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:35 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Volume c8c0e166-0933-4eb0-bbdd-0a13083795fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8c0e166-0933-4eb0-bbdd-0a13083795fc', 'volume_size': 1} Jul 08 01:24:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:35 devstack sudo[105428]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76e02d0b-8537-429b-8473-707be770f8e7 1073741824" returned: 0 in 1.012s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76e02d0b-8537-429b-8473-707be770f8e7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:35 devstack sudo[105436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76e02d0b-8537-429b-8473-707be770f8e7 Jul 08 01:24:35 devstack sudo[105436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:35 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8766e858-554d-4f20-b903-33d285136c91 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.768s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:35 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-8766e858-554d-4f20-b903-33d285136c91 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:35 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-8766e858-554d-4f20-b903-33d285136c91 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Deleted volume successfully. Jul 08 01:24:35 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8766e858-554d-4f20-b903-33d285136c91 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-58d11d9e-d420-4253-ab3a-2c7a57d4a6cc-delete_volume" released by "delete_volume" :: held 3.162s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:35 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8e67b0f7-08f7-4cd9-876b-7e637039e578 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "cinder-9a1ec317-c0de-4413-b5b9-1140f361fbdf-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:36 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8e67b0f7-08f7-4cd9-876b-7e637039e578 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-9a1ec317-c0de-4413-b5b9-1140f361fbdf-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:36 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8e67b0f7-08f7-4cd9-876b-7e637039e578 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "cinder-quobyte-9a1ec317-c0de-4413-b5b9-1140f361fbdf" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:36 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8e67b0f7-08f7-4cd9-876b-7e637039e578 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-quobyte-9a1ec317-c0de-4413-b5b9-1140f361fbdf" acquired by "delete_volume" :: waited 0.017s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:36 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[43bc9833-9156-42ef-858c-7ed5aa518669]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8e67b0f7-08f7-4cd9-876b-7e637039e578 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a1ec317-c0de-4413-b5b9-1140f361fbdf {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:36 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a1ec317-c0de-4413-b5b9-1140f361fbdf Jul 08 01:24:36 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:36 devstack sudo[105436]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76e02d0b-8537-429b-8473-707be770f8e7" returned: 0 in 0.716s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:24:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.775s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.313s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1776514149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efbc88703c94f9499ffa74854b55244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:32Z,use_quota=True,user_id='5d1460445eba4ec68c0d237f9597422b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:24:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Creating volume 9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:24:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:36 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:24:36 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:24:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (133fae89-a383-48c4-bc38-53eee8c9915d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76e02d0b-8537-429b-8473-707be770f8e7', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f658b045-7e11-4bd9-9101-9418f3502386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:36 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c 1073741824 Jul 08 01:24:36 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:36 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Volume volume-76e02d0b-8537-429b-8473-707be770f8e7 (76e02d0b-8537-429b-8473-707be770f8e7): created successfully Jul 08 01:24:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f658b045-7e11-4bd9-9101-9418f3502386) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:36 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Flow 'volume_create_manager' (3b071ef9-93b8-4885-9c34-06ccba2f9248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:36 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-e580d157-b24f-4f6e-9369-60b8a90cb4df tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Created volume successfully. Jul 08 01:24:37 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8e67b0f7-08f7-4cd9-876b-7e637039e578 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a1ec317-c0de-4413-b5b9-1140f361fbdf" returned: 0 in 0.886s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8e67b0f7-08f7-4cd9-876b-7e637039e578 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a1ec317-c0de-4413-b5b9-1140f361fbdf {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:37 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a1ec317-c0de-4413-b5b9-1140f361fbdf Jul 08 01:24:37 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:37 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c 1073741824" returned: 0 in 1.003s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:37 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=103,cinder:UPDATE=146,cinder:INSERT=46,cinder:DELETE=12 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:24:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:37 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c Jul 08 01:24:37 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:37 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8e67b0f7-08f7-4cd9-876b-7e637039e578 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9a1ec317-c0de-4413-b5b9-1140f361fbdf" returned: 0 in 0.748s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:37 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8e67b0f7-08f7-4cd9-876b-7e637039e578 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-quobyte-9a1ec317-c0de-4413-b5b9-1140f361fbdf" released by "delete_volume" :: held 1.691s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:37 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=131,cinder:UPDATE=150,cinder:DELETE=18,cinder:INSERT=37 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:24:37 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-8e67b0f7-08f7-4cd9-876b-7e637039e578 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Created reservations ['6ea391da-18f4-4d5b-a770-aec85bf1246b', '7b718d9b-5821-4fef-a9b3-e945afb8c2b1', '4781f954-8dd5-4f66-ac1f-52ce2b829bb2', 'f7cabbdb-941a-45a5-859e-d4e853eb7e0a'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8e67b0f7-08f7-4cd9-876b-7e637039e578 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8e67b0f7-08f7-4cd9-876b-7e637039e578 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-8e67b0f7-08f7-4cd9-876b-7e637039e578 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:37 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-8e67b0f7-08f7-4cd9-876b-7e637039e578 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8e67b0f7-08f7-4cd9-876b-7e637039e578 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8e67b0f7-08f7-4cd9-876b-7e637039e578 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:37 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:24:37 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:38 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c" returned: 0 in 0.780s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.113s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-565821899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2bfb7d9-641f-43fe-b190-8bad030744e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efbc88703c94f9499ffa74854b55244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:33Z,use_quota=True,user_id='5d1460445eba4ec68c0d237f9597422b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Creating volume a2bfb7d9-641f-43fe-b190-8bad030744e8 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:24:38 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2bfb7d9-641f-43fe-b190-8bad030744e8 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:38 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2bfb7d9-641f-43fe-b190-8bad030744e8 1073741824 Jul 08 01:24:38 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d2ca975c-116e-4e4d-b8d9-1b81ded0bb7a tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "cinder-b16f773a-3b0e-4127-b79e-2aa5dc02c7ce-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d2ca975c-116e-4e4d-b8d9-1b81ded0bb7a tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-b16f773a-3b0e-4127-b79e-2aa5dc02c7ce-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc43eac8-d014-4ca2-8572-95c94889c22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48b34fa-25c9-40bd-9d23-4f7478fef69e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:38 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Volume volume-9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c (9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c): created successfully Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d48b34fa-25c9-40bd-9d23-4f7478fef69e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Flow 'volume_create_manager' (08c947a5-8662-4b04-bb6d-cf0cd3f7166a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d2ca975c-116e-4e4d-b8d9-1b81ded0bb7a tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "cinder-quobyte-b16f773a-3b0e-4127-b79e-2aa5dc02c7ce" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:38 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-bd997194-516b-4235-a11b-87d0e14238f5 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Created volume successfully. Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d2ca975c-116e-4e4d-b8d9-1b81ded0bb7a tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-quobyte-b16f773a-3b0e-4127-b79e-2aa5dc02c7ce" acquired by "delete_volume" :: waited 0.030s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6be7c5-2a66-4063-a648-40792339fc31]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d2ca975c-116e-4e4d-b8d9-1b81ded0bb7a tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b16f773a-3b0e-4127-b79e-2aa5dc02c7ce {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:38 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b16f773a-3b0e-4127-b79e-2aa5dc02c7ce Jul 08 01:24:38 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:38 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8e67b0f7-08f7-4cd9-876b-7e637039e578 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.841s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-8e67b0f7-08f7-4cd9-876b-7e637039e578 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:38 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-8e67b0f7-08f7-4cd9-876b-7e637039e578 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Deleted volume successfully. Jul 08 01:24:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8e67b0f7-08f7-4cd9-876b-7e637039e578 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-9a1ec317-c0de-4413-b5b9-1140f361fbdf-delete_volume" released by "delete_volume" :: held 2.800s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:39 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d2ca975c-116e-4e4d-b8d9-1b81ded0bb7a tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b16f773a-3b0e-4127-b79e-2aa5dc02c7ce" returned: 0 in 0.901s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d2ca975c-116e-4e4d-b8d9-1b81ded0bb7a tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b16f773a-3b0e-4127-b79e-2aa5dc02c7ce {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:39 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b16f773a-3b0e-4127-b79e-2aa5dc02c7ce Jul 08 01:24:39 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:39 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2bfb7d9-641f-43fe-b190-8bad030744e8 1073741824" returned: 0 in 1.212s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2bfb7d9-641f-43fe-b190-8bad030744e8 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:39 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2bfb7d9-641f-43fe-b190-8bad030744e8 Jul 08 01:24:39 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:40 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d2ca975c-116e-4e4d-b8d9-1b81ded0bb7a tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b16f773a-3b0e-4127-b79e-2aa5dc02c7ce" returned: 0 in 0.718s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d2ca975c-116e-4e4d-b8d9-1b81ded0bb7a tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-quobyte-b16f773a-3b0e-4127-b79e-2aa5dc02c7ce" released by "delete_volume" :: held 1.684s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-d2ca975c-116e-4e4d-b8d9-1b81ded0bb7a tempest-CreateVolumesFromSnapshotTest-1074724995 None] Created reservations ['a8485c99-6361-46a9-989f-2475291a807a', 'c038231e-c24b-4683-9f8b-a1cd1b4e7303', '556420db-756c-4d9d-8546-c2f5773c80b7', '112ccc73-4018-4e09-9b68-5b75ee5ebc8d'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d2ca975c-116e-4e4d-b8d9-1b81ded0bb7a tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d2ca975c-116e-4e4d-b8d9-1b81ded0bb7a tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d2ca975c-116e-4e4d-b8d9-1b81ded0bb7a tempest-CreateVolumesFromSnapshotTest-1074724995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d2ca975c-116e-4e4d-b8d9-1b81ded0bb7a tempest-CreateVolumesFromSnapshotTest-1074724995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d2ca975c-116e-4e4d-b8d9-1b81ded0bb7a tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d2ca975c-116e-4e4d-b8d9-1b81ded0bb7a tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:40 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2bfb7d9-641f-43fe-b190-8bad030744e8" returned: 0 in 0.813s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] <== create_volume: return (2086ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.094s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:40 devstack sudo[105477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.889s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:40 devstack sudo[105477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-40439118',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26a7e3a6-8f91-4fba-b916-bb782b4cd4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8efbc88703c94f9499ffa74854b55244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:33Z,use_quota=True,user_id='5d1460445eba4ec68c0d237f9597422b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Creating volume 26a7e3a6-8f91-4fba-b916-bb782b4cd4fc {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:24:40 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-26a7e3a6-8f91-4fba-b916-bb782b4cd4fc 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (605cf411-5738-4f36-8ac4-3d20bfc94493) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2bfb7d9-641f-43fe-b190-8bad030744e8', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:40 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-26a7e3a6-8f91-4fba-b916-bb782b4cd4fc 1073741824 Jul 08 01:24:40 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (842379c3-a31f-4c7b-8ce0-3c8fb36661d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:40 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Volume volume-a2bfb7d9-641f-43fe-b190-8bad030744e8 (a2bfb7d9-641f-43fe-b190-8bad030744e8): created successfully Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (842379c3-a31f-4c7b-8ce0-3c8fb36661d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Flow 'volume_create_manager' (c99f8fd4-166a-462a-bc47-b83e6364dc5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:40 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f7b5d740-8f44-4674-a9c5-da98a6b037b1 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Created volume successfully. Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a9a62bcc-d200-444e-a51c-e8cbcf71a1e4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "cinder-4d8812a5-00c5-42af-a693-473f027802a5-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a9a62bcc-d200-444e-a51c-e8cbcf71a1e4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-4d8812a5-00c5-42af-a693-473f027802a5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a9a62bcc-d200-444e-a51c-e8cbcf71a1e4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "cinder-quobyte-4d8812a5-00c5-42af-a693-473f027802a5" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a9a62bcc-d200-444e-a51c-e8cbcf71a1e4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-quobyte-4d8812a5-00c5-42af-a693-473f027802a5" acquired by "delete_volume" :: waited 0.028s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc791aa-20f7-441a-b5ee-f00dd0400e4e]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9a62bcc-d200-444e-a51c-e8cbcf71a1e4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4d8812a5-00c5-42af-a693-473f027802a5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:40 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4d8812a5-00c5-42af-a693-473f027802a5 Jul 08 01:24:41 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:41 devstack sudo[105477]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d2ca975c-116e-4e4d-b8d9-1b81ded0bb7a tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.814s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:41 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-d2ca975c-116e-4e4d-b8d9-1b81ded0bb7a tempest-CreateVolumesFromSnapshotTest-1074724995 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:41 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-d2ca975c-116e-4e4d-b8d9-1b81ded0bb7a tempest-CreateVolumesFromSnapshotTest-1074724995 None] Deleted volume successfully. Jul 08 01:24:41 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-d2ca975c-116e-4e4d-b8d9-1b81ded0bb7a tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-b16f773a-3b0e-4127-b79e-2aa5dc02c7ce-delete_volume" released by "delete_volume" :: held 2.826s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:41 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-26a7e3a6-8f91-4fba-b916-bb782b4cd4fc 1073741824" returned: 0 in 1.101s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-26a7e3a6-8f91-4fba-b916-bb782b4cd4fc {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:41 devstack sudo[105489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-26a7e3a6-8f91-4fba-b916-bb782b4cd4fc Jul 08 01:24:41 devstack sudo[105489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:41 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9a62bcc-d200-444e-a51c-e8cbcf71a1e4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4d8812a5-00c5-42af-a693-473f027802a5" returned: 0 in 1.024s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9a62bcc-d200-444e-a51c-e8cbcf71a1e4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4d8812a5-00c5-42af-a693-473f027802a5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:41 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4d8812a5-00c5-42af-a693-473f027802a5 Jul 08 01:24:41 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:42 devstack sudo[105489]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-26a7e3a6-8f91-4fba-b916-bb782b4cd4fc" returned: 0 in 0.714s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.875s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.660s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-549136345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8c0e166-0933-4eb0-bbdd-0a13083795fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b494986802e847a4affb97c98aa065de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:35Z,use_quota=True,user_id='623652f2428c42bfa392b84db656aa0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Creating volume c8c0e166-0933-4eb0-bbdd-0a13083795fc {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:24:42 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8c0e166-0933-4eb0-bbdd-0a13083795fc 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2167a0cf-7950-4cf9-a1c9-e433c98477e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26a7e3a6-8f91-4fba-b916-bb782b4cd4fc', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43268eb7-f142-4e87-a9a8-7534b01adb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:42 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8c0e166-0933-4eb0-bbdd-0a13083795fc 1073741824 Jul 08 01:24:42 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:42 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Volume volume-26a7e3a6-8f91-4fba-b916-bb782b4cd4fc (26a7e3a6-8f91-4fba-b916-bb782b4cd4fc): created successfully Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43268eb7-f142-4e87-a9a8-7534b01adb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Flow 'volume_create_manager' (587bc7ae-dabd-4fc0-a81e-91061fb27506) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:42 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-eb2e9922-bf42-4d86-86c6-c7037c36939a tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Created volume successfully. Jul 08 01:24:42 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9a62bcc-d200-444e-a51c-e8cbcf71a1e4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-4d8812a5-00c5-42af-a693-473f027802a5" returned: 0 in 0.766s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a9a62bcc-d200-444e-a51c-e8cbcf71a1e4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-quobyte-4d8812a5-00c5-42af-a693-473f027802a5" released by "delete_volume" :: held 1.871s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-a9a62bcc-d200-444e-a51c-e8cbcf71a1e4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Created reservations ['b7eebe7f-30de-4e20-b9f4-2ead1dc0017c', 'b550c99a-f1a5-4a31-9b29-ed8356a1c051', 'bad0a63c-4404-4b32-a070-a4742f8019e8', '6961f797-567b-44b0-ac15-3b9b720594a6'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a9a62bcc-d200-444e-a51c-e8cbcf71a1e4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a9a62bcc-d200-444e-a51c-e8cbcf71a1e4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a9a62bcc-d200-444e-a51c-e8cbcf71a1e4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a9a62bcc-d200-444e-a51c-e8cbcf71a1e4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a9a62bcc-d200-444e-a51c-e8cbcf71a1e4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9a62bcc-d200-444e-a51c-e8cbcf71a1e4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:42 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:24:42 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:42 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8cc9d8f3-bb0e-4e04-adbf-27fcd654a4cf tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "cinder-e47e2c20-176d-44d4-82e0-b7718167ca19-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8cc9d8f3-bb0e-4e04-adbf-27fcd654a4cf tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-e47e2c20-176d-44d4-82e0-b7718167ca19-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8cc9d8f3-bb0e-4e04-adbf-27fcd654a4cf tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "cinder-quobyte-e47e2c20-176d-44d4-82e0-b7718167ca19" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8cc9d8f3-bb0e-4e04-adbf-27fcd654a4cf tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-quobyte-e47e2c20-176d-44d4-82e0-b7718167ca19" acquired by "delete_volume" :: waited 0.017s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:43 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d967fb6-1954-4e6f-9e09-48c415a7852e]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8cc9d8f3-bb0e-4e04-adbf-27fcd654a4cf tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e47e2c20-176d-44d4-82e0-b7718167ca19 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:43 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e47e2c20-176d-44d4-82e0-b7718167ca19 Jul 08 01:24:43 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0b271a37-b4a8-4455-b200-e20cbd1d5084 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "cinder-26a7e3a6-8f91-4fba-b916-bb782b4cd4fc-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:43 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0b271a37-b4a8-4455-b200-e20cbd1d5084 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-26a7e3a6-8f91-4fba-b916-bb782b4cd4fc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8c0e166-0933-4eb0-bbdd-0a13083795fc 1073741824" returned: 0 in 1.223s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0b271a37-b4a8-4455-b200-e20cbd1d5084 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "cinder-quobyte-26a7e3a6-8f91-4fba-b916-bb782b4cd4fc" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8c0e166-0933-4eb0-bbdd-0a13083795fc {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0b271a37-b4a8-4455-b200-e20cbd1d5084 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-quobyte-26a7e3a6-8f91-4fba-b916-bb782b4cd4fc" acquired by "delete_volume" :: waited 0.030s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:43 devstack sudo[105510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8c0e166-0933-4eb0-bbdd-0a13083795fc Jul 08 01:24:43 devstack sudo[105510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:43 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[c124aeff-ce1a-4964-acbd-5086c069e56a]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0b271a37-b4a8-4455-b200-e20cbd1d5084 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-26a7e3a6-8f91-4fba-b916-bb782b4cd4fc {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:43 devstack sudo[105512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-26a7e3a6-8f91-4fba-b916-bb782b4cd4fc Jul 08 01:24:43 devstack sudo[105512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:43 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a9a62bcc-d200-444e-a51c-e8cbcf71a1e4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.129s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:43 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-a9a62bcc-d200-444e-a51c-e8cbcf71a1e4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:43 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-a9a62bcc-d200-444e-a51c-e8cbcf71a1e4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Deleted volume successfully. Jul 08 01:24:44 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a9a62bcc-d200-444e-a51c-e8cbcf71a1e4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-4d8812a5-00c5-42af-a693-473f027802a5-delete_volume" released by "delete_volume" :: held 3.317s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:44 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8cc9d8f3-bb0e-4e04-adbf-27fcd654a4cf tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e47e2c20-176d-44d4-82e0-b7718167ca19" returned: 0 in 1.068s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8cc9d8f3-bb0e-4e04-adbf-27fcd654a4cf tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e47e2c20-176d-44d4-82e0-b7718167ca19 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:44 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e47e2c20-176d-44d4-82e0-b7718167ca19 Jul 08 01:24:44 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:44 devstack sudo[105510]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8c0e166-0933-4eb0-bbdd-0a13083795fc" returned: 0 in 0.970s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] <== create_volume: return (2278ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:24:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.281s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:44 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef793b7-c4f1-4813-880f-75711732d587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8c0e166-0933-4eb0-bbdd-0a13083795fc', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:44 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e25864-e4f7-4830-85ca-358a8a483ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:44 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Volume volume-c8c0e166-0933-4eb0-bbdd-0a13083795fc (c8c0e166-0933-4eb0-bbdd-0a13083795fc): created successfully Jul 08 01:24:44 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e25864-e4f7-4830-85ca-358a8a483ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:44 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Flow 'volume_create_manager' (85ad21d1-189d-47a7-a81e-43884befd869) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:44 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-58339378-65e6-4b09-a2f5-72b1dcc88c8a tempest-ProjectReaderTests-699754700 None] Created volume successfully. Jul 08 01:24:44 devstack sudo[105512]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0b271a37-b4a8-4455-b200-e20cbd1d5084 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-26a7e3a6-8f91-4fba-b916-bb782b4cd4fc" returned: 0 in 1.165s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0b271a37-b4a8-4455-b200-e20cbd1d5084 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-26a7e3a6-8f91-4fba-b916-bb782b4cd4fc {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:44 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-26a7e3a6-8f91-4fba-b916-bb782b4cd4fc Jul 08 01:24:44 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:24:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:44 devstack sudo[105528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:24:44 devstack sudo[105528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:45 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8cc9d8f3-bb0e-4e04-adbf-27fcd654a4cf tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e47e2c20-176d-44d4-82e0-b7718167ca19" returned: 0 in 0.876s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:45 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8cc9d8f3-bb0e-4e04-adbf-27fcd654a4cf tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-quobyte-e47e2c20-176d-44d4-82e0-b7718167ca19" released by "delete_volume" :: held 2.008s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:45 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-8cc9d8f3-bb0e-4e04-adbf-27fcd654a4cf tempest-CreateVolumesFromSnapshotTest-1074724995 None] Created reservations ['f5e4af73-b545-4b16-81bb-ea0234033e8f', 'f26f3dcb-a144-4c1e-8d92-ba44245e3b51', 'a7c20c73-8b98-412c-90ae-ccb55b715d8e', '6b14e636-3cb6-405b-9eec-f3a72d379d53'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8cc9d8f3-bb0e-4e04-adbf-27fcd654a4cf tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8cc9d8f3-bb0e-4e04-adbf-27fcd654a4cf tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:45 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-8cc9d8f3-bb0e-4e04-adbf-27fcd654a4cf tempest-CreateVolumesFromSnapshotTest-1074724995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:45 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-8cc9d8f3-bb0e-4e04-adbf-27fcd654a4cf tempest-CreateVolumesFromSnapshotTest-1074724995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-8cc9d8f3-bb0e-4e04-adbf-27fcd654a4cf tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8cc9d8f3-bb0e-4e04-adbf-27fcd654a4cf tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:45 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-18ff274c-a78a-4d6b-aec6-5a518f605de4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "cinder-49d4c612-1ff6-428d-8a1f-e51c39aa4a70-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:45 devstack sudo[105530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:24:45 devstack sudo[105530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:45 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-18ff274c-a78a-4d6b-aec6-5a518f605de4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-49d4c612-1ff6-428d-8a1f-e51c39aa4a70-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:45 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-18ff274c-a78a-4d6b-aec6-5a518f605de4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "cinder-quobyte-5caf9355-7c80-4708-b0c4-136aa31087fa" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:45 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-18ff274c-a78a-4d6b-aec6-5a518f605de4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-quobyte-5caf9355-7c80-4708-b0c4-136aa31087fa" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:45 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-18ff274c-a78a-4d6b-aec6-5a518f605de4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "cinder-quobyte-49d4c612-1ff6-428d-8a1f-e51c39aa4a70" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:45 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-18ff274c-a78a-4d6b-aec6-5a518f605de4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-quobyte-49d4c612-1ff6-428d-8a1f-e51c39aa4a70" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:45 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-18ff274c-a78a-4d6b-aec6-5a518f605de4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Deleting offline snapshot 49d4c612-1ff6-428d-8a1f-e51c39aa4a70 of volume 5caf9355-7c80-4708-b0c4-136aa31087fa {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:24:45 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-18ff274c-a78a-4d6b-aec6-5a518f605de4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] snapshot_file for this snap is: volume-5caf9355-7c80-4708-b0c4-136aa31087fa.49d4c612-1ff6-428d-8a1f-e51c39aa4a70 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:24:45 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[3305a4a8-8ddc-4a0d-9134-88a9d8fb442a]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-18ff274c-a78a-4d6b-aec6-5a518f605de4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.49d4c612-1ff6-428d-8a1f-e51c39aa4a70 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:45 devstack sudo[105532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.49d4c612-1ff6-428d-8a1f-e51c39aa4a70 Jul 08 01:24:45 devstack sudo[105532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:45 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0b271a37-b4a8-4455-b200-e20cbd1d5084 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-26a7e3a6-8f91-4fba-b916-bb782b4cd4fc" returned: 0 in 1.119s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:45 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b47ce0c0-6f9f-4f1f-a158-37a06b3956ff tempest-ProjectReaderTests-699754700 None] Acquiring lock "cinder-c8c0e166-0933-4eb0-bbdd-0a13083795fc-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:45 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0b271a37-b4a8-4455-b200-e20cbd1d5084 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-quobyte-26a7e3a6-8f91-4fba-b916-bb782b4cd4fc" released by "delete_volume" :: held 2.376s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:45 devstack sudo[105528]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.048s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b47ce0c0-6f9f-4f1f-a158-37a06b3956ff tempest-ProjectReaderTests-699754700 None] Lock "cinder-c8c0e166-0933-4eb0-bbdd-0a13083795fc-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 28 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b47ce0c0-6f9f-4f1f-a158-37a06b3956ff tempest-ProjectReaderTests-699754700 None] Acquiring lock "cinder-quobyte-c8c0e166-0933-4eb0-bbdd-0a13083795fc" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-0b271a37-b4a8-4455-b200-e20cbd1d5084 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Created reservations ['92e9b27c-989c-4235-abd2-3cd1090f1c47', '59597892-8f94-4a07-8fd8-5ea59be73535', 'ce17070a-0e9c-4811-951c-002c8a808328', '7d81a60c-2636-464b-a3e1-b84124d5b263'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b47ce0c0-6f9f-4f1f-a158-37a06b3956ff tempest-ProjectReaderTests-699754700 None] Lock "cinder-quobyte-c8c0e166-0933-4eb0-bbdd-0a13083795fc" acquired by "delete_volume" :: waited 0.045s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd86a7f5-e68b-4c1b-b018-e7b858d507d1]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b47ce0c0-6f9f-4f1f-a158-37a06b3956ff tempest-ProjectReaderTests-699754700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8c0e166-0933-4eb0-bbdd-0a13083795fc {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0b271a37-b4a8-4455-b200-e20cbd1d5084 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0b271a37-b4a8-4455-b200-e20cbd1d5084 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0b271a37-b4a8-4455-b200-e20cbd1d5084 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0b271a37-b4a8-4455-b200-e20cbd1d5084 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0b271a37-b4a8-4455-b200-e20cbd1d5084 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0b271a37-b4a8-4455-b200-e20cbd1d5084 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:46 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8c0e166-0933-4eb0-bbdd-0a13083795fc Jul 08 01:24:46 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:46 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:24:46 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:46 devstack sudo[105530]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-8cc9d8f3-bb0e-4e04-adbf-27fcd654a4cf tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.143s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-8cc9d8f3-bb0e-4e04-adbf-27fcd654a4cf tempest-CreateVolumesFromSnapshotTest-1074724995 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:46 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-8cc9d8f3-bb0e-4e04-adbf-27fcd654a4cf tempest-CreateVolumesFromSnapshotTest-1074724995 None] Deleted volume successfully. Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-8cc9d8f3-bb0e-4e04-adbf-27fcd654a4cf tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-e47e2c20-176d-44d4-82e0-b7718167ca19-delete_volume" released by "delete_volume" :: held 3.508s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:46 devstack sudo[105532]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-18ff274c-a78a-4d6b-aec6-5a518f605de4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.49d4c612-1ff6-428d-8a1f-e51c39aa4a70" returned: 0 in 1.080s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-18ff274c-a78a-4d6b-aec6-5a518f605de4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5caf9355-7c80-4708-b0c4-136aa31087fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6a23fb-ff5f-4a60-8538-fe2eb40e5cd1]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-18ff274c-a78a-4d6b-aec6-5a518f605de4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:46 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa Jul 08 01:24:46 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-47bc7734-e194-486f-97e3-11167ffe0e49 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "cinder-a2bfb7d9-641f-43fe-b190-8bad030744e8-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-47bc7734-e194-486f-97e3-11167ffe0e49 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-a2bfb7d9-641f-43fe-b190-8bad030744e8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-47bc7734-e194-486f-97e3-11167ffe0e49 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "cinder-quobyte-a2bfb7d9-641f-43fe-b190-8bad030744e8" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-47bc7734-e194-486f-97e3-11167ffe0e49 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-quobyte-a2bfb7d9-641f-43fe-b190-8bad030744e8" acquired by "delete_volume" :: waited 0.033s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:47 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd4360f3-941b-4a2b-bb4d-7cde5b992bd9]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-47bc7734-e194-486f-97e3-11167ffe0e49 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2bfb7d9-641f-43fe-b190-8bad030744e8 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:47 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0b271a37-b4a8-4455-b200-e20cbd1d5084 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.849s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:47 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-0b271a37-b4a8-4455-b200-e20cbd1d5084 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:47 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-0b271a37-b4a8-4455-b200-e20cbd1d5084 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Deleted volume successfully. Jul 08 01:24:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-0b271a37-b4a8-4455-b200-e20cbd1d5084 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-26a7e3a6-8f91-4fba-b916-bb782b4cd4fc-delete_volume" released by "delete_volume" :: held 3.713s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:47 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b47ce0c0-6f9f-4f1f-a158-37a06b3956ff tempest-ProjectReaderTests-699754700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8c0e166-0933-4eb0-bbdd-0a13083795fc" returned: 0 in 1.091s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b47ce0c0-6f9f-4f1f-a158-37a06b3956ff tempest-ProjectReaderTests-699754700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8c0e166-0933-4eb0-bbdd-0a13083795fc {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:47 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2bfb7d9-641f-43fe-b190-8bad030744e8 Jul 08 01:24:47 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:47 devstack sudo[105551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8c0e166-0933-4eb0-bbdd-0a13083795fc Jul 08 01:24:47 devstack sudo[105551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:47 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-18ff274c-a78a-4d6b-aec6-5a518f605de4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa" returned: 0 in 0.999s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-18ff274c-a78a-4d6b-aec6-5a518f605de4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.49d4c612-1ff6-428d-8a1f-e51c39aa4a70 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:47 devstack sudo[105558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.49d4c612-1ff6-428d-8a1f-e51c39aa4a70 Jul 08 01:24:47 devstack sudo[105558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:48 devstack sudo[105551]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b47ce0c0-6f9f-4f1f-a158-37a06b3956ff tempest-ProjectReaderTests-699754700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-c8c0e166-0933-4eb0-bbdd-0a13083795fc" returned: 0 in 0.835s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:48 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:48 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b47ce0c0-6f9f-4f1f-a158-37a06b3956ff tempest-ProjectReaderTests-699754700 None] Lock "cinder-quobyte-c8c0e166-0933-4eb0-bbdd-0a13083795fc" released by "delete_volume" :: held 1.993s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-47bc7734-e194-486f-97e3-11167ffe0e49 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2bfb7d9-641f-43fe-b190-8bad030744e8" returned: 0 in 1.015s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-47bc7734-e194-486f-97e3-11167ffe0e49 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2bfb7d9-641f-43fe-b190-8bad030744e8 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:48 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2bfb7d9-641f-43fe-b190-8bad030744e8 Jul 08 01:24:48 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:48 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-b47ce0c0-6f9f-4f1f-a158-37a06b3956ff tempest-ProjectReaderTests-699754700 None] Created reservations ['f40a0770-9748-43d6-9a64-f62d25597aa0', '99595acd-3f19-4c0f-9005-36cbf5d09a13', 'acfcea97-88b6-404b-b2d3-07f980b3de03', '193a581d-90f2-4f2c-8b09-844c591976ed'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b47ce0c0-6f9f-4f1f-a158-37a06b3956ff tempest-ProjectReaderTests-699754700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b47ce0c0-6f9f-4f1f-a158-37a06b3956ff tempest-ProjectReaderTests-699754700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b47ce0c0-6f9f-4f1f-a158-37a06b3956ff tempest-ProjectReaderTests-699754700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b47ce0c0-6f9f-4f1f-a158-37a06b3956ff tempest-ProjectReaderTests-699754700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b47ce0c0-6f9f-4f1f-a158-37a06b3956ff tempest-ProjectReaderTests-699754700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b47ce0c0-6f9f-4f1f-a158-37a06b3956ff tempest-ProjectReaderTests-699754700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:48 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:24:48 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:48 devstack sudo[105558]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-18ff274c-a78a-4d6b-aec6-5a518f605de4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.49d4c612-1ff6-428d-8a1f-e51c39aa4a70" returned: 0 in 0.939s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-18ff274c-a78a-4d6b-aec6-5a518f605de4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.49d4c612-1ff6-428d-8a1f-e51c39aa4a70 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:48 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.49d4c612-1ff6-428d-8a1f-e51c39aa4a70 Jul 08 01:24:48 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:48 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-47bc7734-e194-486f-97e3-11167ffe0e49 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-a2bfb7d9-641f-43fe-b190-8bad030744e8" returned: 0 in 0.794s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:48 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-47bc7734-e194-486f-97e3-11167ffe0e49 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-quobyte-a2bfb7d9-641f-43fe-b190-8bad030744e8" released by "delete_volume" :: held 1.873s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:49 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-47bc7734-e194-486f-97e3-11167ffe0e49 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Created reservations ['03354490-bf82-4207-9255-82bae1739f8c', '154fbafa-8c0a-44c6-b76a-555b13dd8717', '0f6f029f-43e8-466e-9a07-c0e904b07c30', '6936b48a-9373-429c-854d-365e0960026f'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-47bc7734-e194-486f-97e3-11167ffe0e49 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-47bc7734-e194-486f-97e3-11167ffe0e49 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:49 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-47bc7734-e194-486f-97e3-11167ffe0e49 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:49 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-47bc7734-e194-486f-97e3-11167ffe0e49 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-47bc7734-e194-486f-97e3-11167ffe0e49 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-47bc7734-e194-486f-97e3-11167ffe0e49 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:49 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:24:49 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:49 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b47ce0c0-6f9f-4f1f-a158-37a06b3956ff tempest-ProjectReaderTests-699754700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.840s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:49 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-b47ce0c0-6f9f-4f1f-a158-37a06b3956ff tempest-ProjectReaderTests-699754700 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:49 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b47ce0c0-6f9f-4f1f-a158-37a06b3956ff tempest-ProjectReaderTests-699754700 None] Deleted volume successfully. Jul 08 01:24:49 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b47ce0c0-6f9f-4f1f-a158-37a06b3956ff tempest-ProjectReaderTests-699754700 None] Lock "cinder-c8c0e166-0933-4eb0-bbdd-0a13083795fc-delete_volume" released by "delete_volume" :: held 3.242s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:49 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6d81a64c-e392-4881-b17e-bbfaf95f1145 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "cinder-9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:49 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6d81a64c-e392-4881-b17e-bbfaf95f1145 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:49 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6d81a64c-e392-4881-b17e-bbfaf95f1145 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "cinder-quobyte-9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:49 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6d81a64c-e392-4881-b17e-bbfaf95f1145 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-quobyte-9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c" acquired by "delete_volume" :: waited 0.028s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:49 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[736f05eb-45ac-4f0c-8099-b2fd49ebe6ef]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6d81a64c-e392-4881-b17e-bbfaf95f1145 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:49 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-18ff274c-a78a-4d6b-aec6-5a518f605de4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa.49d4c612-1ff6-428d-8a1f-e51c39aa4a70" returned: 0 in 0.906s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:49 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-18ff274c-a78a-4d6b-aec6-5a518f605de4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-quobyte-49d4c612-1ff6-428d-8a1f-e51c39aa4a70" released by "_delete_snapshot" :: held 4.097s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:49 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-18ff274c-a78a-4d6b-aec6-5a518f605de4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-quobyte-5caf9355-7c80-4708-b0c4-136aa31087fa" released by "delete_snapshot" :: held 4.148s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:49 devstack sudo[105579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c Jul 08 01:24:49 devstack sudo[105579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:49 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-18ff274c-a78a-4d6b-aec6-5a518f605de4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Created reservations ['de691360-966a-4d76-891e-63cbe45216dd', 'dec36fd2-923f-4341-8513-08dc1985bf3e', 'efea61f4-477c-4d1d-8d89-9f1dcdfa40cc', '2d961341-115a-4ea3-907c-b7e37a181501'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:49 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-18ff274c-a78a-4d6b-aec6-5a518f605de4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Delete snapshot completed successfully. Jul 08 01:24:49 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-18ff274c-a78a-4d6b-aec6-5a518f605de4 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-49d4c612-1ff6-428d-8a1f-e51c39aa4a70-delete_snapshot" released by "delete_snapshot" :: held 4.459s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Flow 'volume_create_manager' (e7246672-40b3-4c16-b60e-47b39ff314b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b854d8a-c22d-4435-a452-81355a1c4dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b854d8a-c22d-4435-a452-81355a1c4dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1749218746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1e3b57-da96-47f2-99cc-c4bceba80485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b494986802e847a4affb97c98aa065de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:50Z,use_quota=True,user_id='623652f2428c42bfa392b84db656aa0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf037207-f796-4ab8-8d87-a38d564f3639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf037207-f796-4ab8-8d87-a38d564f3639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbcef5f8-f629-462f-8986-c1c31f8d695e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbcef5f8-f629-462f-8986-c1c31f8d695e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a1e3b57-da96-47f2-99cc-c4bceba80485', 'volume_name': 'volume-8a1e3b57-da96-47f2-99cc-c4bceba80485', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:50 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1164f66-2d70-4257-8a4f-4963a9dfc734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1164f66-2d70-4257-8a4f-4963a9dfc734) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7b08b2-05ee-450b-b247-22058b0fb8dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:50 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Volume 8a1e3b57-da96-47f2-99cc-c4bceba80485: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a1e3b57-da96-47f2-99cc-c4bceba80485', 'volume_size': 1} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1749218746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1e3b57-da96-47f2-99cc-c4bceba80485,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b494986802e847a4affb97c98aa065de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:24:50Z,use_quota=True,user_id='623652f2428c42bfa392b84db656aa0c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Creating volume 8a1e3b57-da96-47f2-99cc-c4bceba80485 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:24:50 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8a1e3b57-da96-47f2-99cc-c4bceba80485 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-47bc7734-e194-486f-97e3-11167ffe0e49 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 1.128s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-47bc7734-e194-486f-97e3-11167ffe0e49 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:50 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-47bc7734-e194-486f-97e3-11167ffe0e49 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Deleted volume successfully. Jul 08 01:24:50 devstack sudo[105582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8a1e3b57-da96-47f2-99cc-c4bceba80485 1073741824 Jul 08 01:24:50 devstack sudo[105582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-47bc7734-e194-486f-97e3-11167ffe0e49 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-a2bfb7d9-641f-43fe-b190-8bad030744e8-delete_volume" released by "delete_volume" :: held 3.306s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:50 devstack sudo[105579]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6d81a64c-e392-4881-b17e-bbfaf95f1145 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c" returned: 0 in 1.150s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6d81a64c-e392-4881-b17e-bbfaf95f1145 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:50 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c Jul 08 01:24:50 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ce5267fa-c121-4c1a-a1d8-2ef96e076726 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "cinder-5caf9355-7c80-4708-b0c4-136aa31087fa-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ce5267fa-c121-4c1a-a1d8-2ef96e076726 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-5caf9355-7c80-4708-b0c4-136aa31087fa-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ce5267fa-c121-4c1a-a1d8-2ef96e076726 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "cinder-quobyte-5caf9355-7c80-4708-b0c4-136aa31087fa" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ce5267fa-c121-4c1a-a1d8-2ef96e076726 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-quobyte-5caf9355-7c80-4708-b0c4-136aa31087fa" acquired by "delete_volume" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[4899be8e-bcc3-4d05-8a34-7e03774c164c]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ce5267fa-c121-4c1a-a1d8-2ef96e076726 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:51 devstack sudo[105590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa Jul 08 01:24:51 devstack sudo[105590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:51 devstack sudo[105582]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8a1e3b57-da96-47f2-99cc-c4bceba80485 1073741824" returned: 0 in 1.136s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8a1e3b57-da96-47f2-99cc-c4bceba80485 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:51 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8a1e3b57-da96-47f2-99cc-c4bceba80485 Jul 08 01:24:51 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:51 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6d81a64c-e392-4881-b17e-bbfaf95f1145 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c" returned: 0 in 0.856s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:51 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6d81a64c-e392-4881-b17e-bbfaf95f1145 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-quobyte-9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c" released by "delete_volume" :: held 2.071s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:51 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-6d81a64c-e392-4881-b17e-bbfaf95f1145 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Created reservations ['00134b82-be37-449d-a681-1c35eb456dda', '871e4ace-ebdb-4c57-a83a-0c7590b98cc0', '2301fdb4-ac2a-4723-a203-579e8aa3878d', 'c418854c-a1e1-4eb3-81cd-37fefd83329e'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6d81a64c-e392-4881-b17e-bbfaf95f1145 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6d81a64c-e392-4881-b17e-bbfaf95f1145 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6d81a64c-e392-4881-b17e-bbfaf95f1145 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6d81a64c-e392-4881-b17e-bbfaf95f1145 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6d81a64c-e392-4881-b17e-bbfaf95f1145 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6d81a64c-e392-4881-b17e-bbfaf95f1145 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:51 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:24:51 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:51 devstack sudo[105590]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ce5267fa-c121-4c1a-a1d8-2ef96e076726 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa" returned: 0 in 0.923s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ce5267fa-c121-4c1a-a1d8-2ef96e076726 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:51 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa Jul 08 01:24:51 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:52 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8a1e3b57-da96-47f2-99cc-c4bceba80485" returned: 0 in 0.788s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] <== create_volume: return (1992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.995s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad7b08b2-05ee-450b-b247-22058b0fb8dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a1e3b57-da96-47f2-99cc-c4bceba80485', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce7ba9b-407b-4291-bb59-44279e9ef937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:24:52 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Volume volume-8a1e3b57-da96-47f2-99cc-c4bceba80485 (8a1e3b57-da96-47f2-99cc-c4bceba80485): created successfully Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dce7ba9b-407b-4291-bb59-44279e9ef937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Flow 'volume_create_manager' (e7246672-40b3-4c16-b60e-47b39ff314b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:24:52 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-a3f43791-c4bf-4cc1-8269-02daa357adbe tempest-ProjectReaderTests-699754700 None] Created volume successfully. Jul 08 01:24:52 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6d81a64c-e392-4881-b17e-bbfaf95f1145 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.868s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-6d81a64c-e392-4881-b17e-bbfaf95f1145 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:52 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-6d81a64c-e392-4881-b17e-bbfaf95f1145 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Deleted volume successfully. Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6d81a64c-e392-4881-b17e-bbfaf95f1145 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-9461704e-cc2e-47a7-a21e-5e4f3d6b7c4c-delete_volume" released by "delete_volume" :: held 3.295s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:52 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ce5267fa-c121-4c1a-a1d8-2ef96e076726 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-5caf9355-7c80-4708-b0c4-136aa31087fa" returned: 0 in 0.787s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1bc9c969-3823-4f75-a172-b54cc1476e37 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "cinder-76e02d0b-8537-429b-8473-707be770f8e7-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ce5267fa-c121-4c1a-a1d8-2ef96e076726 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-quobyte-5caf9355-7c80-4708-b0c4-136aa31087fa" released by "delete_volume" :: held 1.840s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1bc9c969-3823-4f75-a172-b54cc1476e37 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-76e02d0b-8537-429b-8473-707be770f8e7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1bc9c969-3823-4f75-a172-b54cc1476e37 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "cinder-quobyte-76e02d0b-8537-429b-8473-707be770f8e7" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-ce5267fa-c121-4c1a-a1d8-2ef96e076726 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Created reservations ['fb78c95c-10d1-4bbe-9dd0-f68c31fa119c', '450737bc-deac-4299-96be-b4251eeeb71f', 'e10c02a4-e764-4506-9798-377a92413d8b', '766bf6af-8166-481b-9dd9-835f18c58083'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1bc9c969-3823-4f75-a172-b54cc1476e37 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-quobyte-76e02d0b-8537-429b-8473-707be770f8e7" acquired by "delete_volume" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[66e36489-2ebf-4170-8ea4-6cc463b226cc]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1bc9c969-3823-4f75-a172-b54cc1476e37 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76e02d0b-8537-429b-8473-707be770f8e7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ce5267fa-c121-4c1a-a1d8-2ef96e076726 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ce5267fa-c121-4c1a-a1d8-2ef96e076726 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ce5267fa-c121-4c1a-a1d8-2ef96e076726 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ce5267fa-c121-4c1a-a1d8-2ef96e076726 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ce5267fa-c121-4c1a-a1d8-2ef96e076726 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ce5267fa-c121-4c1a-a1d8-2ef96e076726 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:52 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76e02d0b-8537-429b-8473-707be770f8e7 Jul 08 01:24:52 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:24:52 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:52 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-63aace7b-535d-459d-9a9d-17825a2acde8 tempest-ProjectReaderTests-699754700 None] Acquiring lock "cinder-8a1e3b57-da96-47f2-99cc-c4bceba80485-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-63aace7b-535d-459d-9a9d-17825a2acde8 tempest-ProjectReaderTests-699754700 None] Lock "cinder-8a1e3b57-da96-47f2-99cc-c4bceba80485-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-63aace7b-535d-459d-9a9d-17825a2acde8 tempest-ProjectReaderTests-699754700 None] Acquiring lock "cinder-quobyte-8a1e3b57-da96-47f2-99cc-c4bceba80485" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-63aace7b-535d-459d-9a9d-17825a2acde8 tempest-ProjectReaderTests-699754700 None] Lock "cinder-quobyte-8a1e3b57-da96-47f2-99cc-c4bceba80485" acquired by "delete_volume" :: waited 0.031s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:53 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d41b1b-ccd8-43d9-8a83-7577b79bd4a9]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63aace7b-535d-459d-9a9d-17825a2acde8 tempest-ProjectReaderTests-699754700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8a1e3b57-da96-47f2-99cc-c4bceba80485 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:53 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8a1e3b57-da96-47f2-99cc-c4bceba80485 Jul 08 01:24:53 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:53 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ce5267fa-c121-4c1a-a1d8-2ef96e076726 tempest-CreateVolumesFromSnapshotTest-1074724995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.998s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:53 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-ce5267fa-c121-4c1a-a1d8-2ef96e076726 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:53 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-ce5267fa-c121-4c1a-a1d8-2ef96e076726 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Deleted volume successfully. Jul 08 01:24:53 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1bc9c969-3823-4f75-a172-b54cc1476e37 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76e02d0b-8537-429b-8473-707be770f8e7" returned: 0 in 1.130s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1bc9c969-3823-4f75-a172-b54cc1476e37 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76e02d0b-8537-429b-8473-707be770f8e7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ce5267fa-c121-4c1a-a1d8-2ef96e076726 tempest-CreateVolumesFromSnapshotTest-1074724995 None] Lock "cinder-5caf9355-7c80-4708-b0c4-136aa31087fa-delete_volume" released by "delete_volume" :: held 3.185s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:54 devstack sudo[105619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76e02d0b-8537-429b-8473-707be770f8e7 Jul 08 01:24:54 devstack sudo[105619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:54 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63aace7b-535d-459d-9a9d-17825a2acde8 tempest-ProjectReaderTests-699754700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8a1e3b57-da96-47f2-99cc-c4bceba80485" returned: 0 in 1.043s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63aace7b-535d-459d-9a9d-17825a2acde8 tempest-ProjectReaderTests-699754700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8a1e3b57-da96-47f2-99cc-c4bceba80485 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:54 devstack sudo[105624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8a1e3b57-da96-47f2-99cc-c4bceba80485 Jul 08 01:24:54 devstack sudo[105624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:54 devstack sudo[105619]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1bc9c969-3823-4f75-a172-b54cc1476e37 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76e02d0b-8537-429b-8473-707be770f8e7" returned: 0 in 0.951s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1bc9c969-3823-4f75-a172-b54cc1476e37 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-quobyte-76e02d0b-8537-429b-8473-707be770f8e7" released by "delete_volume" :: held 2.133s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:55 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-1bc9c969-3823-4f75-a172-b54cc1476e37 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Created reservations ['ed5e5131-3e3b-4adc-b5fa-7ace97a5dfcf', '9ec20594-c1b5-4b95-91b6-cbdeb061fb6c', '62959fd5-72c9-4eb8-a9af-8d16bd145d39', '2ce23285-72c8-4e68-832d-ecf6fc8ef667'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1bc9c969-3823-4f75-a172-b54cc1476e37 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1bc9c969-3823-4f75-a172-b54cc1476e37 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1bc9c969-3823-4f75-a172-b54cc1476e37 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1bc9c969-3823-4f75-a172-b54cc1476e37 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1bc9c969-3823-4f75-a172-b54cc1476e37 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1bc9c969-3823-4f75-a172-b54cc1476e37 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:55 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:24:55 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:55 devstack sudo[105624]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63aace7b-535d-459d-9a9d-17825a2acde8 tempest-ProjectReaderTests-699754700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8a1e3b57-da96-47f2-99cc-c4bceba80485" returned: 0 in 0.966s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-63aace7b-535d-459d-9a9d-17825a2acde8 tempest-ProjectReaderTests-699754700 None] Lock "cinder-quobyte-8a1e3b57-da96-47f2-99cc-c4bceba80485" released by "delete_volume" :: held 2.083s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:55 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-63aace7b-535d-459d-9a9d-17825a2acde8 tempest-ProjectReaderTests-699754700 None] Created reservations ['a8bc3d6d-d376-4326-897b-364986518b62', 'ce4cc200-1514-45ef-b979-fd5d6390925f', 'b910febf-bc97-4d21-8fb9-433bbf6b4205', 'a073fe4c-8073-4264-b3f7-c2df43aaff79'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63aace7b-535d-459d-9a9d-17825a2acde8 tempest-ProjectReaderTests-699754700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63aace7b-535d-459d-9a9d-17825a2acde8 tempest-ProjectReaderTests-699754700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63aace7b-535d-459d-9a9d-17825a2acde8 tempest-ProjectReaderTests-699754700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63aace7b-535d-459d-9a9d-17825a2acde8 tempest-ProjectReaderTests-699754700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63aace7b-535d-459d-9a9d-17825a2acde8 tempest-ProjectReaderTests-699754700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63aace7b-535d-459d-9a9d-17825a2acde8 tempest-ProjectReaderTests-699754700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:55 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:24:55 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:56 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1bc9c969-3823-4f75-a172-b54cc1476e37 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.932s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:56 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-1bc9c969-3823-4f75-a172-b54cc1476e37 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:56 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-1bc9c969-3823-4f75-a172-b54cc1476e37 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Deleted volume successfully. Jul 08 01:24:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1bc9c969-3823-4f75-a172-b54cc1476e37 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-76e02d0b-8537-429b-8473-707be770f8e7-delete_volume" released by "delete_volume" :: held 3.418s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4a598311-0da1-4618-91a6-a08e4f53779b tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "cinder-528a9ae2-42ac-41fe-80e0-224c38c12ffa-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4a598311-0da1-4618-91a6-a08e4f53779b tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-528a9ae2-42ac-41fe-80e0-224c38c12ffa-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4a598311-0da1-4618-91a6-a08e4f53779b tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "cinder-quobyte-528a9ae2-42ac-41fe-80e0-224c38c12ffa" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4a598311-0da1-4618-91a6-a08e4f53779b tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-quobyte-528a9ae2-42ac-41fe-80e0-224c38c12ffa" acquired by "delete_volume" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:56 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[c09d5f5f-2ca0-4e02-a796-9930afa1f3de]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4a598311-0da1-4618-91a6-a08e4f53779b tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-528a9ae2-42ac-41fe-80e0-224c38c12ffa {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:56 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-528a9ae2-42ac-41fe-80e0-224c38c12ffa Jul 08 01:24:56 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:56 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63aace7b-535d-459d-9a9d-17825a2acde8 tempest-ProjectReaderTests-699754700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.827s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:56 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63aace7b-535d-459d-9a9d-17825a2acde8 tempest-ProjectReaderTests-699754700 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:56 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-63aace7b-535d-459d-9a9d-17825a2acde8 tempest-ProjectReaderTests-699754700 None] Deleted volume successfully. Jul 08 01:24:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-63aace7b-535d-459d-9a9d-17825a2acde8 tempest-ProjectReaderTests-699754700 None] Lock "cinder-8a1e3b57-da96-47f2-99cc-c4bceba80485-delete_volume" released by "delete_volume" :: held 3.265s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:57 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4a598311-0da1-4618-91a6-a08e4f53779b tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-528a9ae2-42ac-41fe-80e0-224c38c12ffa" returned: 0 in 1.026s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4a598311-0da1-4618-91a6-a08e4f53779b tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-528a9ae2-42ac-41fe-80e0-224c38c12ffa {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:57 devstack sudo[105640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-528a9ae2-42ac-41fe-80e0-224c38c12ffa Jul 08 01:24:57 devstack sudo[105640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:58 devstack sudo[105640]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4a598311-0da1-4618-91a6-a08e4f53779b tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-528a9ae2-42ac-41fe-80e0-224c38c12ffa" returned: 0 in 0.815s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4a598311-0da1-4618-91a6-a08e4f53779b tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-quobyte-528a9ae2-42ac-41fe-80e0-224c38c12ffa" released by "delete_volume" :: held 1.904s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:58 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-4a598311-0da1-4618-91a6-a08e4f53779b tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Created reservations ['34ae8ef0-cb7a-4521-9a12-fc524fc79e34', '7578b917-3b86-443a-98f1-a537fcfc4154', 'a2224c58-7b61-428e-9ada-eab594985624', 'edc779a6-7616-4d29-8f4c-da6e03a64e17'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:24:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4a598311-0da1-4618-91a6-a08e4f53779b tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:24:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4a598311-0da1-4618-91a6-a08e4f53779b tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:24:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4a598311-0da1-4618-91a6-a08e4f53779b tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:24:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4a598311-0da1-4618-91a6-a08e4f53779b tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:24:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4a598311-0da1-4618-91a6-a08e4f53779b tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:24:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4a598311-0da1-4618-91a6-a08e4f53779b tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:58 devstack sudo[105643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:24:58 devstack sudo[105643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-acf75762-697f-4cee-a130-355b31565ca6 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "cinder-00725db2-701d-4a9e-94b7-6856b1234b95-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-acf75762-697f-4cee-a130-355b31565ca6 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-00725db2-701d-4a9e-94b7-6856b1234b95-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-acf75762-697f-4cee-a130-355b31565ca6 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "cinder-quobyte-00725db2-701d-4a9e-94b7-6856b1234b95" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:24:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-acf75762-697f-4cee-a130-355b31565ca6 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-quobyte-00725db2-701d-4a9e-94b7-6856b1234b95" acquired by "delete_volume" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:24:58 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b5bc15-15f5-4cbd-ae57-7fbb66d00ad2]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:24:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-acf75762-697f-4cee-a130-355b31565ca6 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-00725db2-701d-4a9e-94b7-6856b1234b95 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:58 devstack sudo[105645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-00725db2-701d-4a9e-94b7-6856b1234b95 Jul 08 01:24:58 devstack sudo[105645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:24:59 devstack sudo[105643]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4a598311-0da1-4618-91a6-a08e4f53779b tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.934s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:59 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-4a598311-0da1-4618-91a6-a08e4f53779b tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:24:59 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-4a598311-0da1-4618-91a6-a08e4f53779b tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Deleted volume successfully. Jul 08 01:24:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4a598311-0da1-4618-91a6-a08e4f53779b tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-528a9ae2-42ac-41fe-80e0-224c38c12ffa-delete_volume" released by "delete_volume" :: held 3.167s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:24:59 devstack sudo[105645]: pam_unix(sudo:session): session closed for user root Jul 08 01:24:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-acf75762-697f-4cee-a130-355b31565ca6 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-00725db2-701d-4a9e-94b7-6856b1234b95" returned: 0 in 1.101s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:24:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-acf75762-697f-4cee-a130-355b31565ca6 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-00725db2-701d-4a9e-94b7-6856b1234b95 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:24:59 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-00725db2-701d-4a9e-94b7-6856b1234b95 Jul 08 01:24:59 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:00 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-acf75762-697f-4cee-a130-355b31565ca6 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-00725db2-701d-4a9e-94b7-6856b1234b95" returned: 0 in 0.714s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:00 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-acf75762-697f-4cee-a130-355b31565ca6 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-quobyte-00725db2-701d-4a9e-94b7-6856b1234b95" released by "delete_volume" :: held 1.897s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:00 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-acf75762-697f-4cee-a130-355b31565ca6 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Created reservations ['f5571832-2360-4a82-8a75-1fe1e7f01c7d', '1f649734-d05c-43ae-a330-ac0a02cfbc5b', '0254b970-e6bc-48f4-9413-2fa734da057f', 'e45500af-59fc-4ef8-bd4b-63c2e0cebf1e'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-acf75762-697f-4cee-a130-355b31565ca6 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-acf75762-697f-4cee-a130-355b31565ca6 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-acf75762-697f-4cee-a130-355b31565ca6 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-acf75762-697f-4cee-a130-355b31565ca6 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-acf75762-697f-4cee-a130-355b31565ca6 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-acf75762-697f-4cee-a130-355b31565ca6 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:00 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:25:00 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:01 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-acf75762-697f-4cee-a130-355b31565ca6 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.846s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:01 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-acf75762-697f-4cee-a130-355b31565ca6 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:01 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-acf75762-697f-4cee-a130-355b31565ca6 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Deleted volume successfully. Jul 08 01:25:01 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-acf75762-697f-4cee-a130-355b31565ca6 tempest-CreateVolumesFromSourceVolumeTest-1382319058 None] Lock "cinder-00725db2-701d-4a9e-94b7-6856b1234b95-delete_volume" released by "delete_volume" :: held 3.060s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:05 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:25:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Flow 'volume_create_manager' (86319225-a48e-4303-9660-873c17489969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71cdb8b-832c-47d7-81ce-e13e23de9dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d71cdb8b-832c-47d7-81ce-e13e23de9dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff82b92-5086-418d-8499-6beae542bd6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30f8341a31474e32b4b964bee5a0eb18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:06Z,use_quota=True,user_id='52ea2b9e098044d284577e414c4cccaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed0b38cc-cc4d-43a4-a5ac-ae32e4fd06f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed0b38cc-cc4d-43a4-a5ac-ae32e4fd06f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50329dd-0961-4814-85e8-cc14664aa2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a50329dd-0961-4814-85e8-cc14664aa2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dff82b92-5086-418d-8499-6beae542bd6c', 'volume_name': 'volume-dff82b92-5086-418d-8499-6beae542bd6c', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b4ed5a-085e-47eb-82b5-a77dd4157e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40b4ed5a-085e-47eb-82b5-a77dd4157e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c06ec55-054e-4258-b427-2b9daf664c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:05 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Volume dff82b92-5086-418d-8499-6beae542bd6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dff82b92-5086-418d-8499-6beae542bd6c', 'volume_size': 1} Jul 08 01:25:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:05 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:05Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dff82b92-5086-418d-8499-6beae542bd6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30f8341a31474e32b4b964bee5a0eb18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:06Z,use_quota=True,user_id='52ea2b9e098044d284577e414c4cccaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:25:05 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Creating volume dff82b92-5086-418d-8499-6beae542bd6c {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:25:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:05 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:05 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:05 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:25:05 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:25:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dff82b92-5086-418d-8499-6beae542bd6c 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:05 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dff82b92-5086-418d-8499-6beae542bd6c 1073741824 Jul 08 01:25:05 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:06 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:25:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Flow 'volume_create_manager' (e57e6567-1510-422e-b087-9c2ab9f7e268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (652e4cfc-643f-4f68-b50a-b4c062bf2d61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (652e4cfc-643f-4f68-b50a-b4c062bf2d61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1041117833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25972eaa-45e9-4cdf-b4f4-d1a961533733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb446c86b7743258e78554d23b104d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:06Z,use_quota=True,user_id='c22268e4ddd34d8eb4bf4ae8a14331a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49191f24-1ac8-476d-9ea2-e29e2f74f6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49191f24-1ac8-476d-9ea2-e29e2f74f6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b7018c-aa09-4d40-ad29-a05a48899eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07b7018c-aa09-4d40-ad29-a05a48899eae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25972eaa-45e9-4cdf-b4f4-d1a961533733', 'volume_name': 'volume-25972eaa-45e9-4cdf-b4f4-d1a961533733', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1b0ae2-7156-4815-a57d-c029cb22db85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb1b0ae2-7156-4815-a57d-c029cb22db85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:06 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32981dff-adb0-4d89-8294-eef545e9a443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:06 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Volume 25972eaa-45e9-4cdf-b4f4-d1a961533733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25972eaa-45e9-4cdf-b4f4-d1a961533733', 'volume_size': 1} Jul 08 01:25:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:06 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dff82b92-5086-418d-8499-6beae542bd6c 1073741824" returned: 0 in 1.092s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dff82b92-5086-418d-8499-6beae542bd6c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:06 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dff82b92-5086-418d-8499-6beae542bd6c Jul 08 01:25:06 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:07 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dff82b92-5086-418d-8499-6beae542bd6c" returned: 0 in 0.721s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:25:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1041117833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25972eaa-45e9-4cdf-b4f4-d1a961533733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb446c86b7743258e78554d23b104d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:06Z,use_quota=True,user_id='c22268e4ddd34d8eb4bf4ae8a14331a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:25:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Creating volume 25972eaa-45e9-4cdf-b4f4-d1a961533733 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:25:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:25:07 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:25:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:07 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733 1073741824 Jul 08 01:25:07 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c06ec55-054e-4258-b427-2b9daf664c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dff82b92-5086-418d-8499-6beae542bd6c', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1858b703-abeb-47f1-8d6e-5c6b24fec94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:07 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Volume volume-dff82b92-5086-418d-8499-6beae542bd6c (dff82b92-5086-418d-8499-6beae542bd6c): created successfully Jul 08 01:25:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1858b703-abeb-47f1-8d6e-5c6b24fec94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Flow 'volume_create_manager' (86319225-a48e-4303-9660-873c17489969) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:07 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-2b06def7-23ff-4f2e-8f65-28f413e2219e tempest-CinderUnicodeTest-892218813 None] Created volume successfully. Jul 08 01:25:08 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733 1073741824" returned: 0 in 0.962s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:08 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733 Jul 08 01:25:08 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Flow 'volume_create_manager' (a4757758-fdf6-46df-a09c-ff4c16f3069f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19cc09e2-b93f-4dd4-900a-5d352d5fe703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19cc09e2-b93f-4dd4-900a-5d352d5fe703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1234335534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222de506-9896-4dc0-ae58-5bd5aa942ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30f8341a31474e32b4b964bee5a0eb18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:09Z,use_quota=True,user_id='52ea2b9e098044d284577e414c4cccaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36614718-efc6-4475-9312-aa6475d4c13b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36614718-efc6-4475-9312-aa6475d4c13b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e42b8be-ade6-4956-8a50-2584d03d7e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e42b8be-ade6-4956-8a50-2584d03d7e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '222de506-9896-4dc0-ae58-5bd5aa942ae7', 'volume_name': 'volume-222de506-9896-4dc0-ae58-5bd5aa942ae7', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d38d00-a792-4956-8ce5-d872889dde86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d38d00-a792-4956-8ce5-d872889dde86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a36c9bb8-8dd0-45c2-b33a-6bcfbfe20c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:09 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Volume 222de506-9896-4dc0-ae58-5bd5aa942ae7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-222de506-9896-4dc0-ae58-5bd5aa942ae7', 'volume_size': 1} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:09 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733" returned: 0 in 0.747s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.060s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:09Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1234335534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=222de506-9896-4dc0-ae58-5bd5aa942ae7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30f8341a31474e32b4b964bee5a0eb18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:09Z,use_quota=True,user_id='52ea2b9e098044d284577e414c4cccaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Creating volume 222de506-9896-4dc0-ae58-5bd5aa942ae7 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:25:09 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32981dff-adb0-4d89-8294-eef545e9a443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25972eaa-45e9-4cdf-b4f4-d1a961533733', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ff695a-2d41-4fe1-bf25-d4e1892ff185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:09 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7 1073741824 Jul 08 01:25:09 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:09 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Volume volume-25972eaa-45e9-4cdf-b4f4-d1a961533733 (25972eaa-45e9-4cdf-b4f4-d1a961533733): created successfully Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31ff695a-2d41-4fe1-bf25-d4e1892ff185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:09 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Flow 'volume_create_manager' (e57e6567-1510-422e-b087-9c2ab9f7e268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:09 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-6c14fccc-bffc-44ad-b235-0347f45e38a9 tempest-ProjectMemberTests-1297668706 None] Created volume successfully. Jul 08 01:25:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-feb3ea80-b1b4-4b1a-972d-1146397194a9 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:10 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7 1073741824" returned: 0 in 0.998s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:10 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7 Jul 08 01:25:10 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:11 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7" returned: 0 in 0.779s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] <== create_volume: return (1840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:25:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-feb3ea80-b1b4-4b1a-972d-1146397194a9 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.197s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:11 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-feb3ea80-b1b4-4b1a-972d-1146397194a9 tempest-ProjectMemberTests-1297668706 None] Creating offline snapshot 2f64dc0f-3548-4850-820b-270bb78ce503 of volume 25972eaa-45e9-4cdf-b4f4-d1a961533733 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:25:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a36c9bb8-8dd0-45c2-b33a-6bcfbfe20c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-222de506-9896-4dc0-ae58-5bd5aa942ae7', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e61ca0f-79a2-4556-8470-723ab660d70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:11 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[6254fca3-27ca-4f6b-a9d1-4f1be81c6f16]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-feb3ea80-b1b4-4b1a-972d-1146397194a9 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:11 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Volume volume-222de506-9896-4dc0-ae58-5bd5aa942ae7 (222de506-9896-4dc0-ae58-5bd5aa942ae7): created successfully Jul 08 01:25:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e61ca0f-79a2-4556-8470-723ab660d70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:11 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Flow 'volume_create_manager' (a4757758-fdf6-46df-a09c-ff4c16f3069f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:11 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-514dae2f-accf-4c3b-bac9-db367cadcca3 tempest-CinderUnicodeTest-892218813 None] Created volume successfully. Jul 08 01:25:11 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733 Jul 08 01:25:11 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:12 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-feb3ea80-b1b4-4b1a-972d-1146397194a9 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733" returned: 0 in 0.797s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-feb3ea80-b1b4-4b1a-972d-1146397194a9 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.2f64dc0f-3548-4850-820b-270bb78ce503 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:12 devstack sudo[105697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.2f64dc0f-3548-4850-820b-270bb78ce503 1G Jul 08 01:25:12 devstack sudo[105697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5c641607-057e-4fc8-9b1e-37669c2bba4b tempest-CinderUnicodeTest-892218813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:13 devstack sudo[105697]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-feb3ea80-b1b4-4b1a-972d-1146397194a9 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.2f64dc0f-3548-4850-820b-270bb78ce503 1G" returned: 0 in 0.988s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-feb3ea80-b1b4-4b1a-972d-1146397194a9 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25972eaa-45e9-4cdf-b4f4-d1a961533733 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.2f64dc0f-3548-4850-820b-270bb78ce503 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:13 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25972eaa-45e9-4cdf-b4f4-d1a961533733 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.2f64dc0f-3548-4850-820b-270bb78ce503 Jul 08 01:25:13 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:13 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-feb3ea80-b1b4-4b1a-972d-1146397194a9 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25972eaa-45e9-4cdf-b4f4-d1a961533733 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.2f64dc0f-3548-4850-820b-270bb78ce503" returned: 0 in 0.847s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:13 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-feb3ea80-b1b4-4b1a-972d-1146397194a9 tempest-ProjectMemberTests-1297668706 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.2f64dc0f-3548-4850-820b-270bb78ce503 is being set with open permissions: ugo+rw Jul 08 01:25:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-feb3ea80-b1b4-4b1a-972d-1146397194a9 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.2f64dc0f-3548-4850-820b-270bb78ce503 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:13 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.2f64dc0f-3548-4850-820b-270bb78ce503 Jul 08 01:25:13 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:14 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-feb3ea80-b1b4-4b1a-972d-1146397194a9 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.2f64dc0f-3548-4850-820b-270bb78ce503" returned: 0 in 0.741s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-feb3ea80-b1b4-4b1a-972d-1146397194a9 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:14 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.info Jul 08 01:25:14 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:15 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-feb3ea80-b1b4-4b1a-972d-1146397194a9 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.info" returned: 0 in 0.694s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:15 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-feb3ea80-b1b4-4b1a-972d-1146397194a9 tempest-ProjectMemberTests-1297668706 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.info is being set with open permissions: ugo+rw Jul 08 01:25:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-feb3ea80-b1b4-4b1a-972d-1146397194a9 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:15 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.info Jul 08 01:25:15 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:16 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-feb3ea80-b1b4-4b1a-972d-1146397194a9 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.info" returned: 0 in 0.704s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-feb3ea80-b1b4-4b1a-972d-1146397194a9 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.882s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5c641607-057e-4fc8-9b1e-37669c2bba4b tempest-CinderUnicodeTest-892218813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.374s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-5c641607-057e-4fc8-9b1e-37669c2bba4b tempest-CinderUnicodeTest-892218813 None] Creating offline snapshot 9db646b3-29c6-4b0b-954c-ceedc9c9d96b of volume 222de506-9896-4dc0-ae58-5bd5aa942ae7 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:25:16 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-feb3ea80-b1b4-4b1a-972d-1146397194a9 tempest-ProjectMemberTests-1297668706 None] Create snapshot completed successfully Jul 08 01:25:16 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b0fdf0-8b8a-40c0-b17a-d62ac94c8dd2]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c641607-057e-4fc8-9b1e-37669c2bba4b tempest-CinderUnicodeTest-892218813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:16 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7 Jul 08 01:25:16 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eb36c7c7-c89b-47eb-a745-e5ff9cc669b5 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-2f64dc0f-3548-4850-820b-270bb78ce503-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eb36c7c7-c89b-47eb-a745-e5ff9cc669b5 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-2f64dc0f-3548-4850-820b-270bb78ce503-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eb36c7c7-c89b-47eb-a745-e5ff9cc669b5 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-25972eaa-45e9-4cdf-b4f4-d1a961533733" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eb36c7c7-c89b-47eb-a745-e5ff9cc669b5 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-25972eaa-45e9-4cdf-b4f4-d1a961533733" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eb36c7c7-c89b-47eb-a745-e5ff9cc669b5 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-2f64dc0f-3548-4850-820b-270bb78ce503" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eb36c7c7-c89b-47eb-a745-e5ff9cc669b5 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-2f64dc0f-3548-4850-820b-270bb78ce503" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-eb36c7c7-c89b-47eb-a745-e5ff9cc669b5 tempest-ProjectMemberTests-1297668706 None] Deleting offline snapshot 2f64dc0f-3548-4850-820b-270bb78ce503 of volume 25972eaa-45e9-4cdf-b4f4-d1a961533733 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:25:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-eb36c7c7-c89b-47eb-a745-e5ff9cc669b5 tempest-ProjectMemberTests-1297668706 None] snapshot_file for this snap is: volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.2f64dc0f-3548-4850-820b-270bb78ce503 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:25:16 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8e45d1-1075-4164-9f03-3d2200cdec51]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eb36c7c7-c89b-47eb-a745-e5ff9cc669b5 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.2f64dc0f-3548-4850-820b-270bb78ce503 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:16 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.2f64dc0f-3548-4850-820b-270bb78ce503 Jul 08 01:25:16 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:17 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c641607-057e-4fc8-9b1e-37669c2bba4b tempest-CinderUnicodeTest-892218813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7" returned: 0 in 0.989s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c641607-057e-4fc8-9b1e-37669c2bba4b tempest-CinderUnicodeTest-892218813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.9db646b3-29c6-4b0b-954c-ceedc9c9d96b 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:17 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.9db646b3-29c6-4b0b-954c-ceedc9c9d96b 1G Jul 08 01:25:17 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:17 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eb36c7c7-c89b-47eb-a745-e5ff9cc669b5 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.2f64dc0f-3548-4850-820b-270bb78ce503" returned: 0 in 1.073s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-eb36c7c7-c89b-47eb-a745-e5ff9cc669b5 tempest-ProjectMemberTests-1297668706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25972eaa-45e9-4cdf-b4f4-d1a961533733(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:25:17 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a298b24-4da8-4f15-9a96-f269a97d6696]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eb36c7c7-c89b-47eb-a745-e5ff9cc669b5 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:17 devstack sudo[106146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733 Jul 08 01:25:17 devstack sudo[106146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:18 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c641607-057e-4fc8-9b1e-37669c2bba4b tempest-CinderUnicodeTest-892218813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.9db646b3-29c6-4b0b-954c-ceedc9c9d96b 1G" returned: 0 in 1.019s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c641607-057e-4fc8-9b1e-37669c2bba4b tempest-CinderUnicodeTest-892218813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-222de506-9896-4dc0-ae58-5bd5aa942ae7 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.9db646b3-29c6-4b0b-954c-ceedc9c9d96b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:18 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-222de506-9896-4dc0-ae58-5bd5aa942ae7 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.9db646b3-29c6-4b0b-954c-ceedc9c9d96b Jul 08 01:25:18 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:18 devstack sudo[106146]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eb36c7c7-c89b-47eb-a745-e5ff9cc669b5 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733" returned: 0 in 0.992s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eb36c7c7-c89b-47eb-a745-e5ff9cc669b5 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.2f64dc0f-3548-4850-820b-270bb78ce503 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:18 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.2f64dc0f-3548-4850-820b-270bb78ce503 Jul 08 01:25:18 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:19 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c641607-057e-4fc8-9b1e-37669c2bba4b tempest-CinderUnicodeTest-892218813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-222de506-9896-4dc0-ae58-5bd5aa942ae7 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.9db646b3-29c6-4b0b-954c-ceedc9c9d96b" returned: 0 in 1.001s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:19 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-5c641607-057e-4fc8-9b1e-37669c2bba4b tempest-CinderUnicodeTest-892218813 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.9db646b3-29c6-4b0b-954c-ceedc9c9d96b is being set with open permissions: ugo+rw Jul 08 01:25:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c641607-057e-4fc8-9b1e-37669c2bba4b tempest-CinderUnicodeTest-892218813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.9db646b3-29c6-4b0b-954c-ceedc9c9d96b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:19 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.9db646b3-29c6-4b0b-954c-ceedc9c9d96b Jul 08 01:25:19 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:19 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eb36c7c7-c89b-47eb-a745-e5ff9cc669b5 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.2f64dc0f-3548-4850-820b-270bb78ce503" returned: 0 in 0.990s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eb36c7c7-c89b-47eb-a745-e5ff9cc669b5 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.2f64dc0f-3548-4850-820b-270bb78ce503 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:19 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.2f64dc0f-3548-4850-820b-270bb78ce503 Jul 08 01:25:19 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:20 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c641607-057e-4fc8-9b1e-37669c2bba4b tempest-CinderUnicodeTest-892218813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.9db646b3-29c6-4b0b-954c-ceedc9c9d96b" returned: 0 in 0.787s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c641607-057e-4fc8-9b1e-37669c2bba4b tempest-CinderUnicodeTest-892218813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:20 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.info Jul 08 01:25:20 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:20 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eb36c7c7-c89b-47eb-a745-e5ff9cc669b5 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733.2f64dc0f-3548-4850-820b-270bb78ce503" returned: 0 in 0.743s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eb36c7c7-c89b-47eb-a745-e5ff9cc669b5 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-2f64dc0f-3548-4850-820b-270bb78ce503" released by "_delete_snapshot" :: held 3.947s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eb36c7c7-c89b-47eb-a745-e5ff9cc669b5 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-25972eaa-45e9-4cdf-b4f4-d1a961533733" released by "delete_snapshot" :: held 3.974s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:20 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-eb36c7c7-c89b-47eb-a745-e5ff9cc669b5 tempest-ProjectMemberTests-1297668706 None] Created reservations ['c3bfdab5-7490-4071-ae4b-b3a252a92adb', '710d4d1a-5a6e-48eb-b1ca-cb3aa485875e', '37c4b783-8758-4817-a03e-84562db67912', 'ddd7310c-7393-4c75-9583-e536c8330e66'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:20 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-eb36c7c7-c89b-47eb-a745-e5ff9cc669b5 tempest-ProjectMemberTests-1297668706 None] Delete snapshot completed successfully. Jul 08 01:25:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eb36c7c7-c89b-47eb-a745-e5ff9cc669b5 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-2f64dc0f-3548-4850-820b-270bb78ce503-delete_snapshot" released by "delete_snapshot" :: held 4.175s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c1db4592-8cb5-4b8d-a0df-b8820036446b tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-25972eaa-45e9-4cdf-b4f4-d1a961533733-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c1db4592-8cb5-4b8d-a0df-b8820036446b tempest-ProjectMemberTests-1297668706 None] Lock "cinder-25972eaa-45e9-4cdf-b4f4-d1a961533733-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c1db4592-8cb5-4b8d-a0df-b8820036446b tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-25972eaa-45e9-4cdf-b4f4-d1a961533733" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:20 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c1db4592-8cb5-4b8d-a0df-b8820036446b tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-25972eaa-45e9-4cdf-b4f4-d1a961533733" acquired by "delete_volume" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:20 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea924d7a-6f25-4154-96d9-8a40d1ac1cfb]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c1db4592-8cb5-4b8d-a0df-b8820036446b tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:20 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c641607-057e-4fc8-9b1e-37669c2bba4b tempest-CinderUnicodeTest-892218813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.info" returned: 0 in 0.796s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:20 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-5c641607-057e-4fc8-9b1e-37669c2bba4b tempest-CinderUnicodeTest-892218813 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.info is being set with open permissions: ugo+rw Jul 08 01:25:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c641607-057e-4fc8-9b1e-37669c2bba4b tempest-CinderUnicodeTest-892218813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:20 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.info Jul 08 01:25:20 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:20 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733 Jul 08 01:25:20 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:21 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5c641607-057e-4fc8-9b1e-37669c2bba4b tempest-CinderUnicodeTest-892218813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.info" returned: 0 in 0.871s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5c641607-057e-4fc8-9b1e-37669c2bba4b tempest-CinderUnicodeTest-892218813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.621s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:21 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-5c641607-057e-4fc8-9b1e-37669c2bba4b tempest-CinderUnicodeTest-892218813 None] Create snapshot completed successfully Jul 08 01:25:21 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c1db4592-8cb5-4b8d-a0df-b8820036446b tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733" returned: 0 in 1.011s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c1db4592-8cb5-4b8d-a0df-b8820036446b tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:21 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733 Jul 08 01:25:21 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3f7401bd-e02f-46bc-9cf1-1225879b257f tempest-CinderUnicodeTest-892218813 None] Acquiring lock "cinder-9db646b3-29c6-4b0b-954c-ceedc9c9d96b-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3f7401bd-e02f-46bc-9cf1-1225879b257f tempest-CinderUnicodeTest-892218813 None] Lock "cinder-9db646b3-29c6-4b0b-954c-ceedc9c9d96b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3f7401bd-e02f-46bc-9cf1-1225879b257f tempest-CinderUnicodeTest-892218813 None] Acquiring lock "cinder-quobyte-222de506-9896-4dc0-ae58-5bd5aa942ae7" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3f7401bd-e02f-46bc-9cf1-1225879b257f tempest-CinderUnicodeTest-892218813 None] Lock "cinder-quobyte-222de506-9896-4dc0-ae58-5bd5aa942ae7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3f7401bd-e02f-46bc-9cf1-1225879b257f tempest-CinderUnicodeTest-892218813 None] Acquiring lock "cinder-quobyte-9db646b3-29c6-4b0b-954c-ceedc9c9d96b" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3f7401bd-e02f-46bc-9cf1-1225879b257f tempest-CinderUnicodeTest-892218813 None] Lock "cinder-quobyte-9db646b3-29c6-4b0b-954c-ceedc9c9d96b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:22 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-3f7401bd-e02f-46bc-9cf1-1225879b257f tempest-CinderUnicodeTest-892218813 None] Deleting offline snapshot 9db646b3-29c6-4b0b-954c-ceedc9c9d96b of volume 222de506-9896-4dc0-ae58-5bd5aa942ae7 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:25:22 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-3f7401bd-e02f-46bc-9cf1-1225879b257f tempest-CinderUnicodeTest-892218813 None] snapshot_file for this snap is: volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.9db646b3-29c6-4b0b-954c-ceedc9c9d96b {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:25:22 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1dd8d10-129e-47f0-ba82-9213c48d6a53]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f7401bd-e02f-46bc-9cf1-1225879b257f tempest-CinderUnicodeTest-892218813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.9db646b3-29c6-4b0b-954c-ceedc9c9d96b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:22 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.9db646b3-29c6-4b0b-954c-ceedc9c9d96b Jul 08 01:25:22 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:22 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c1db4592-8cb5-4b8d-a0df-b8820036446b tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-25972eaa-45e9-4cdf-b4f4-d1a961533733" returned: 0 in 0.752s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:22 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c1db4592-8cb5-4b8d-a0df-b8820036446b tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-25972eaa-45e9-4cdf-b4f4-d1a961533733" released by "delete_volume" :: held 1.845s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:22 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-c1db4592-8cb5-4b8d-a0df-b8820036446b tempest-ProjectMemberTests-1297668706 None] Created reservations ['637a469a-e9ad-4b7a-a397-53c84a8acdf5', 'eec61372-81d7-44f6-801f-5229f15e806a', '7a1c8aa9-fbed-46d4-a7a1-1698e313edab', '1ab1cb51-c088-4822-bd65-c18edfa80b47'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c1db4592-8cb5-4b8d-a0df-b8820036446b tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c1db4592-8cb5-4b8d-a0df-b8820036446b tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:22 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c1db4592-8cb5-4b8d-a0df-b8820036446b tempest-ProjectMemberTests-1297668706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:22 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c1db4592-8cb5-4b8d-a0df-b8820036446b tempest-ProjectMemberTests-1297668706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c1db4592-8cb5-4b8d-a0df-b8820036446b tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c1db4592-8cb5-4b8d-a0df-b8820036446b tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:22 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:25:22 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:23 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f7401bd-e02f-46bc-9cf1-1225879b257f tempest-CinderUnicodeTest-892218813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.9db646b3-29c6-4b0b-954c-ceedc9c9d96b" returned: 0 in 1.177s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-3f7401bd-e02f-46bc-9cf1-1225879b257f tempest-CinderUnicodeTest-892218813 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-222de506-9896-4dc0-ae58-5bd5aa942ae7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9a015c-1b00-4180-9f7f-a72e09494804]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f7401bd-e02f-46bc-9cf1-1225879b257f tempest-CinderUnicodeTest-892218813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Flow 'volume_create_manager' (bdfac8d3-6218-484f-a1dc-9a14de1ad7d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12c7ee3-fa78-4b8a-bb88-eccc58fabfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b12c7ee3-fa78-4b8a-bb88-eccc58fabfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2133372266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8890f0c1-7859-4995-b1e1-f0b03e7eee82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb446c86b7743258e78554d23b104d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:24Z,use_quota=True,user_id='c22268e4ddd34d8eb4bf4ae8a14331a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a48362-c968-499d-824f-be24a5d7c4a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a48362-c968-499d-824f-be24a5d7c4a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7c1844-4033-480e-8777-89b9ec8ce64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c7c1844-4033-480e-8777-89b9ec8ce64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8890f0c1-7859-4995-b1e1-f0b03e7eee82', 'volume_name': 'volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14969c2e-a762-42fb-82f9-f1258c636adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14969c2e-a762-42fb-82f9-f1258c636adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408484d7-f8f6-4f91-9599-9f7b94f93dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:23 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Volume 8890f0c1-7859-4995-b1e1-f0b03e7eee82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82', 'volume_size': 1} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:23 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2133372266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8890f0c1-7859-4995-b1e1-f0b03e7eee82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb446c86b7743258e78554d23b104d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:24Z,use_quota=True,user_id='c22268e4ddd34d8eb4bf4ae8a14331a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Creating volume 8890f0c1-7859-4995-b1e1-f0b03e7eee82 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:25:23 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c1db4592-8cb5-4b8d-a0df-b8820036446b tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.957s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-c1db4592-8cb5-4b8d-a0df-b8820036446b tempest-ProjectMemberTests-1297668706 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:23 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7 Jul 08 01:25:23 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:23 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-c1db4592-8cb5-4b8d-a0df-b8820036446b tempest-ProjectMemberTests-1297668706 None] Deleted volume successfully. Jul 08 01:25:23 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82 1073741824 Jul 08 01:25:23 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-c1db4592-8cb5-4b8d-a0df-b8820036446b tempest-ProjectMemberTests-1297668706 None] Lock "cinder-25972eaa-45e9-4cdf-b4f4-d1a961533733-delete_volume" released by "delete_volume" :: held 3.069s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:24 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f7401bd-e02f-46bc-9cf1-1225879b257f tempest-CinderUnicodeTest-892218813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7" returned: 0 in 1.014s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f7401bd-e02f-46bc-9cf1-1225879b257f tempest-CinderUnicodeTest-892218813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.9db646b3-29c6-4b0b-954c-ceedc9c9d96b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:24 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.9db646b3-29c6-4b0b-954c-ceedc9c9d96b Jul 08 01:25:24 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:24 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:25:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Flow 'volume_create_manager' (9c816583-d980-40f9-9213-12eb06921ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08248726-f25f-447c-8955-77f5000b800e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08248726-f25f-447c-8955-77f5000b800e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-162055011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f876d4-2651-4bc2-b1b8-d5d2c45deae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ab470f96ab4eb5a8f534af2ddddc82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:25Z,use_quota=True,user_id='0040aa9a0825483ead24ba43e2e95560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55287882-d500-4811-b5db-3305c5471fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55287882-d500-4811-b5db-3305c5471fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ee9714-cda2-425d-8d51-1ef9c91be79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0ee9714-cda2-425d-8d51-1ef9c91be79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2f876d4-2651-4bc2-b1b8-d5d2c45deae6', 'volume_name': 'volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96fdd61e-8df5-4468-8676-81a1ea64d771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96fdd61e-8df5-4468-8676-81a1ea64d771) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:24 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3d2955-152b-4b6a-9818-fe181c2b427c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:24 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Volume d2f876d4-2651-4bc2-b1b8-d5d2c45deae6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6', 'volume_size': 1} Jul 08 01:25:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:24 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82 1073741824" returned: 0 in 1.091s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:24 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82 Jul 08 01:25:24 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:25 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f7401bd-e02f-46bc-9cf1-1225879b257f tempest-CinderUnicodeTest-892218813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.9db646b3-29c6-4b0b-954c-ceedc9c9d96b" returned: 0 in 0.800s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f7401bd-e02f-46bc-9cf1-1225879b257f tempest-CinderUnicodeTest-892218813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.9db646b3-29c6-4b0b-954c-ceedc9c9d96b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:25 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.9db646b3-29c6-4b0b-954c-ceedc9c9d96b Jul 08 01:25:25 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:25 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82" returned: 0 in 0.725s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] <== create_volume: return (1858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:25:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.819s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-162055011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2f876d4-2651-4bc2-b1b8-d5d2c45deae6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ab470f96ab4eb5a8f534af2ddddc82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:25Z,use_quota=True,user_id='0040aa9a0825483ead24ba43e2e95560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:25:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Creating volume d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:25:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:25:25 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:25:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (408484d7-f8f6-4f91-9599-9f7b94f93dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:25 devstack sudo[106259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 1073741824 Jul 08 01:25:25 devstack sudo[106259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f2656b-4eb3-44ac-8406-9d03c4245f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:25 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Volume volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82 (8890f0c1-7859-4995-b1e1-f0b03e7eee82): created successfully Jul 08 01:25:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53f2656b-4eb3-44ac-8406-9d03c4245f16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:25 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Flow 'volume_create_manager' (bdfac8d3-6218-484f-a1dc-9a14de1ad7d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:25 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-792d2287-8d51-44e3-8b10-b22d2d93a69a tempest-ProjectMemberTests-1297668706 None] Created volume successfully. Jul 08 01:25:26 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-3f7401bd-e02f-46bc-9cf1-1225879b257f tempest-CinderUnicodeTest-892218813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7.9db646b3-29c6-4b0b-954c-ceedc9c9d96b" returned: 0 in 0.715s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3f7401bd-e02f-46bc-9cf1-1225879b257f tempest-CinderUnicodeTest-892218813 None] Lock "cinder-quobyte-9db646b3-29c6-4b0b-954c-ceedc9c9d96b" released by "_delete_snapshot" :: held 3.838s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3f7401bd-e02f-46bc-9cf1-1225879b257f tempest-CinderUnicodeTest-892218813 None] Lock "cinder-quobyte-222de506-9896-4dc0-ae58-5bd5aa942ae7" released by "delete_snapshot" :: held 3.871s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:26 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-3f7401bd-e02f-46bc-9cf1-1225879b257f tempest-CinderUnicodeTest-892218813 None] Created reservations ['d6e1d871-493f-4187-89b7-f39ba7a1e174', '7a20f4a9-90c0-4583-a79f-66cc1455d83d', '1188d5cb-f6a1-4455-800a-81a388dfbb4d', '4218e35e-a8dc-4018-ba89-685b19c37976'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:26 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-3f7401bd-e02f-46bc-9cf1-1225879b257f tempest-CinderUnicodeTest-892218813 None] Delete snapshot completed successfully. Jul 08 01:25:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-3f7401bd-e02f-46bc-9cf1-1225879b257f tempest-CinderUnicodeTest-892218813 None] Lock "cinder-9db646b3-29c6-4b0b-954c-ceedc9c9d96b-delete_snapshot" released by "delete_snapshot" :: held 4.018s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:26 devstack sudo[106259]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 1073741824" returned: 0 in 0.902s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ff34edb0-c062-44ef-8ce6-a995c764b988 tempest-CinderUnicodeTest-892218813 None] Acquiring lock "cinder-222de506-9896-4dc0-ae58-5bd5aa942ae7-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ff34edb0-c062-44ef-8ce6-a995c764b988 tempest-CinderUnicodeTest-892218813 None] Lock "cinder-222de506-9896-4dc0-ae58-5bd5aa942ae7-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:26 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 Jul 08 01:25:26 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ff34edb0-c062-44ef-8ce6-a995c764b988 tempest-CinderUnicodeTest-892218813 None] Acquiring lock "cinder-quobyte-222de506-9896-4dc0-ae58-5bd5aa942ae7" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ff34edb0-c062-44ef-8ce6-a995c764b988 tempest-CinderUnicodeTest-892218813 None] Lock "cinder-quobyte-222de506-9896-4dc0-ae58-5bd5aa942ae7" acquired by "delete_volume" :: waited 0.017s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:26 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5397e96-a08f-47a2-9377-21c7ad69e010]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ff34edb0-c062-44ef-8ce6-a995c764b988 tempest-CinderUnicodeTest-892218813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:26 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7 Jul 08 01:25:26 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-746d675c-4dc4-4d53-989f-10a3c6da2faf tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:27 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6" returned: 0 in 0.693s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:25:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-746d675c-4dc4-4d53-989f-10a3c6da2faf tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.322s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af3d2955-152b-4b6a-9818-fe181c2b427c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af6a35e-83da-4df2-b236-2c0b034e547f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-746d675c-4dc4-4d53-989f-10a3c6da2faf tempest-ProjectMemberTests-1297668706 None] Creating offline snapshot fa4dfc28-07ed-45e5-a3e9-415944f3d6a5 of volume 8890f0c1-7859-4995-b1e1-f0b03e7eee82 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:25:27 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Volume volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 (d2f876d4-2651-4bc2-b1b8-d5d2c45deae6): created successfully Jul 08 01:25:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9af6a35e-83da-4df2-b236-2c0b034e547f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:27 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Flow 'volume_create_manager' (9c816583-d980-40f9-9213-12eb06921ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:27 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[c198824c-8d1a-4f09-af6a-51c1b328f296]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-746d675c-4dc4-4d53-989f-10a3c6da2faf tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:27 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-630725af-4ab0-4d99-b26e-4ae5fa1da737 tempest-SnapshotDependencyTests-898400410 None] Created volume successfully. Jul 08 01:25:27 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82 Jul 08 01:25:27 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:27 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ff34edb0-c062-44ef-8ce6-a995c764b988 tempest-CinderUnicodeTest-892218813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7" returned: 0 in 0.842s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ff34edb0-c062-44ef-8ce6-a995c764b988 tempest-CinderUnicodeTest-892218813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:27 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7 Jul 08 01:25:27 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:28 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-746d675c-4dc4-4d53-989f-10a3c6da2faf tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82" returned: 0 in 0.898s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-746d675c-4dc4-4d53-989f-10a3c6da2faf tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.fa4dfc28-07ed-45e5-a3e9-415944f3d6a5 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:28 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ff34edb0-c062-44ef-8ce6-a995c764b988 tempest-CinderUnicodeTest-892218813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-222de506-9896-4dc0-ae58-5bd5aa942ae7" returned: 0 in 0.727s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:28 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.fa4dfc28-07ed-45e5-a3e9-415944f3d6a5 1G Jul 08 01:25:28 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ff34edb0-c062-44ef-8ce6-a995c764b988 tempest-CinderUnicodeTest-892218813 None] Lock "cinder-quobyte-222de506-9896-4dc0-ae58-5bd5aa942ae7" released by "delete_volume" :: held 1.662s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e9507e49-f95c-4a84-afc6-01bf96198085 tempest-SnapshotDependencyTests-898400410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:28 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-ff34edb0-c062-44ef-8ce6-a995c764b988 tempest-CinderUnicodeTest-892218813 None] Created reservations ['75f01dd9-cd4c-4a95-adfc-b79b1934e1a3', '078beb97-478e-4cb7-bfd0-ddb0527b7199', 'b21ea2f3-019a-43e0-b380-f5cf5dc0ece8', 'dc21baf2-c67d-400f-b501-c32d9d60e681'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ff34edb0-c062-44ef-8ce6-a995c764b988 tempest-CinderUnicodeTest-892218813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ff34edb0-c062-44ef-8ce6-a995c764b988 tempest-CinderUnicodeTest-892218813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:28 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ff34edb0-c062-44ef-8ce6-a995c764b988 tempest-CinderUnicodeTest-892218813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:28 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ff34edb0-c062-44ef-8ce6-a995c764b988 tempest-CinderUnicodeTest-892218813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ff34edb0-c062-44ef-8ce6-a995c764b988 tempest-CinderUnicodeTest-892218813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ff34edb0-c062-44ef-8ce6-a995c764b988 tempest-CinderUnicodeTest-892218813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:28 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:25:28 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-53515917-c73d-4ab7-8f04-3b338418ffab tempest-CinderUnicodeTest-892218813 None] Acquiring lock "cinder-dff82b92-5086-418d-8499-6beae542bd6c-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-53515917-c73d-4ab7-8f04-3b338418ffab tempest-CinderUnicodeTest-892218813 None] Lock "cinder-dff82b92-5086-418d-8499-6beae542bd6c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-53515917-c73d-4ab7-8f04-3b338418ffab tempest-CinderUnicodeTest-892218813 None] Acquiring lock "cinder-quobyte-dff82b92-5086-418d-8499-6beae542bd6c" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-53515917-c73d-4ab7-8f04-3b338418ffab tempest-CinderUnicodeTest-892218813 None] Lock "cinder-quobyte-dff82b92-5086-418d-8499-6beae542bd6c" acquired by "delete_volume" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:28 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c5db08-98e8-46bc-a5a3-55b91bb0e4e8]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-53515917-c73d-4ab7-8f04-3b338418ffab tempest-CinderUnicodeTest-892218813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dff82b92-5086-418d-8499-6beae542bd6c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:29 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dff82b92-5086-418d-8499-6beae542bd6c Jul 08 01:25:29 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:29 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ff34edb0-c062-44ef-8ce6-a995c764b988 tempest-CinderUnicodeTest-892218813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.718s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:29 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-ff34edb0-c062-44ef-8ce6-a995c764b988 tempest-CinderUnicodeTest-892218813 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:29 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-ff34edb0-c062-44ef-8ce6-a995c764b988 tempest-CinderUnicodeTest-892218813 None] Deleted volume successfully. Jul 08 01:25:29 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-746d675c-4dc4-4d53-989f-10a3c6da2faf tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.fa4dfc28-07ed-45e5-a3e9-415944f3d6a5 1G" returned: 0 in 0.964s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-746d675c-4dc4-4d53-989f-10a3c6da2faf tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.fa4dfc28-07ed-45e5-a3e9-415944f3d6a5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:29 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-ff34edb0-c062-44ef-8ce6-a995c764b988 tempest-CinderUnicodeTest-892218813 None] Lock "cinder-222de506-9896-4dc0-ae58-5bd5aa942ae7-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:29 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.fa4dfc28-07ed-45e5-a3e9-415944f3d6a5 Jul 08 01:25:29 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:29 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-53515917-c73d-4ab7-8f04-3b338418ffab tempest-CinderUnicodeTest-892218813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dff82b92-5086-418d-8499-6beae542bd6c" returned: 0 in 0.878s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-53515917-c73d-4ab7-8f04-3b338418ffab tempest-CinderUnicodeTest-892218813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dff82b92-5086-418d-8499-6beae542bd6c {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:29 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dff82b92-5086-418d-8499-6beae542bd6c Jul 08 01:25:29 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:29 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-746d675c-4dc4-4d53-989f-10a3c6da2faf tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.fa4dfc28-07ed-45e5-a3e9-415944f3d6a5" returned: 0 in 0.753s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:29 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-746d675c-4dc4-4d53-989f-10a3c6da2faf tempest-ProjectMemberTests-1297668706 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.fa4dfc28-07ed-45e5-a3e9-415944f3d6a5 is being set with open permissions: ugo+rw Jul 08 01:25:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-746d675c-4dc4-4d53-989f-10a3c6da2faf tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.fa4dfc28-07ed-45e5-a3e9-415944f3d6a5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:29 devstack sudo[106304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.fa4dfc28-07ed-45e5-a3e9-415944f3d6a5 Jul 08 01:25:29 devstack sudo[106304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:30 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-53515917-c73d-4ab7-8f04-3b338418ffab tempest-CinderUnicodeTest-892218813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dff82b92-5086-418d-8499-6beae542bd6c" returned: 0 in 0.779s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:30 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-53515917-c73d-4ab7-8f04-3b338418ffab tempest-CinderUnicodeTest-892218813 None] Lock "cinder-quobyte-dff82b92-5086-418d-8499-6beae542bd6c" released by "delete_volume" :: held 1.702s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:30 devstack sudo[106304]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:30 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-53515917-c73d-4ab7-8f04-3b338418ffab tempest-CinderUnicodeTest-892218813 None] Created reservations ['798b8536-8b29-4a8a-81fc-d98e7478e4ad', '953bb325-5e4a-4a59-ad24-7bd03404257e', '2734628f-7d08-4045-a399-c7a3ed183eda', '68116678-5072-4498-b440-32da20ed6fcc'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-746d675c-4dc4-4d53-989f-10a3c6da2faf tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.fa4dfc28-07ed-45e5-a3e9-415944f3d6a5" returned: 0 in 0.705s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-746d675c-4dc4-4d53-989f-10a3c6da2faf tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:30 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.info Jul 08 01:25:30 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-53515917-c73d-4ab7-8f04-3b338418ffab tempest-CinderUnicodeTest-892218813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-53515917-c73d-4ab7-8f04-3b338418ffab tempest-CinderUnicodeTest-892218813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-53515917-c73d-4ab7-8f04-3b338418ffab tempest-CinderUnicodeTest-892218813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-53515917-c73d-4ab7-8f04-3b338418ffab tempest-CinderUnicodeTest-892218813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-53515917-c73d-4ab7-8f04-3b338418ffab tempest-CinderUnicodeTest-892218813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-53515917-c73d-4ab7-8f04-3b338418ffab tempest-CinderUnicodeTest-892218813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:30 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:25:30 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:31 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-53515917-c73d-4ab7-8f04-3b338418ffab tempest-CinderUnicodeTest-892218813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.699s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:31 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-53515917-c73d-4ab7-8f04-3b338418ffab tempest-CinderUnicodeTest-892218813 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:31 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-53515917-c73d-4ab7-8f04-3b338418ffab tempest-CinderUnicodeTest-892218813 None] Deleted volume successfully. Jul 08 01:25:31 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-53515917-c73d-4ab7-8f04-3b338418ffab tempest-CinderUnicodeTest-892218813 None] Lock "cinder-dff82b92-5086-418d-8499-6beae542bd6c-delete_volume" released by "delete_volume" :: held 2.667s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:31 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-746d675c-4dc4-4d53-989f-10a3c6da2faf tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.info" returned: 0 in 0.814s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:31 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-746d675c-4dc4-4d53-989f-10a3c6da2faf tempest-ProjectMemberTests-1297668706 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.info is being set with open permissions: ugo+rw Jul 08 01:25:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-746d675c-4dc4-4d53-989f-10a3c6da2faf tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:31 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.info Jul 08 01:25:31 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:32 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-746d675c-4dc4-4d53-989f-10a3c6da2faf tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.info" returned: 0 in 0.712s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-746d675c-4dc4-4d53-989f-10a3c6da2faf tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.990s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e9507e49-f95c-4a84-afc6-01bf96198085 tempest-SnapshotDependencyTests-898400410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.946s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-e9507e49-f95c-4a84-afc6-01bf96198085 tempest-SnapshotDependencyTests-898400410 None] Creating offline snapshot 45a68a03-5058-4017-9e3f-a1a4bc8891b9 of volume d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:25:32 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-746d675c-4dc4-4d53-989f-10a3c6da2faf tempest-ProjectMemberTests-1297668706 None] Create snapshot completed successfully Jul 08 01:25:32 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[f636eb77-902f-4a7e-b5a3-58211c4b62c5]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e9507e49-f95c-4a84-afc6-01bf96198085 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:32 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 Jul 08 01:25:32 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-04f4c6df-2e26-4f59-9e4b-8f24af439af9 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-fa4dfc28-07ed-45e5-a3e9-415944f3d6a5-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-04f4c6df-2e26-4f59-9e4b-8f24af439af9 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-fa4dfc28-07ed-45e5-a3e9-415944f3d6a5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-04f4c6df-2e26-4f59-9e4b-8f24af439af9 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-8890f0c1-7859-4995-b1e1-f0b03e7eee82" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-04f4c6df-2e26-4f59-9e4b-8f24af439af9 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-8890f0c1-7859-4995-b1e1-f0b03e7eee82" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-04f4c6df-2e26-4f59-9e4b-8f24af439af9 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-fa4dfc28-07ed-45e5-a3e9-415944f3d6a5" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:33 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e9507e49-f95c-4a84-afc6-01bf96198085 tempest-SnapshotDependencyTests-898400410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6" returned: 0 in 0.943s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e9507e49-f95c-4a84-afc6-01bf96198085 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:33 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-04f4c6df-2e26-4f59-9e4b-8f24af439af9 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-fa4dfc28-07ed-45e5-a3e9-415944f3d6a5" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-04f4c6df-2e26-4f59-9e4b-8f24af439af9 tempest-ProjectMemberTests-1297668706 None] Deleting offline snapshot fa4dfc28-07ed-45e5-a3e9-415944f3d6a5 of volume 8890f0c1-7859-4995-b1e1-f0b03e7eee82 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:25:33 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9 1G Jul 08 01:25:33 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-04f4c6df-2e26-4f59-9e4b-8f24af439af9 tempest-ProjectMemberTests-1297668706 None] snapshot_file for this snap is: volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.fa4dfc28-07ed-45e5-a3e9-415944f3d6a5 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:25:33 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f1adc2-2fe5-4caf-b77a-761edfe26ed1]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-04f4c6df-2e26-4f59-9e4b-8f24af439af9 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.fa4dfc28-07ed-45e5-a3e9-415944f3d6a5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:33 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.fa4dfc28-07ed-45e5-a3e9-415944f3d6a5 Jul 08 01:25:33 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:34 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:34 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-04f4c6df-2e26-4f59-9e4b-8f24af439af9 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.fa4dfc28-07ed-45e5-a3e9-415944f3d6a5" returned: 0 in 0.837s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-04f4c6df-2e26-4f59-9e4b-8f24af439af9 tempest-ProjectMemberTests-1297668706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:25:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e9507e49-f95c-4a84-afc6-01bf96198085 tempest-SnapshotDependencyTests-898400410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9 1G" returned: 0 in 0.922s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e9507e49-f95c-4a84-afc6-01bf96198085 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:34 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[e514db2a-9686-4c3b-9608-5eaaec669629]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-04f4c6df-2e26-4f59-9e4b-8f24af439af9 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:34 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9 Jul 08 01:25:34 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:34 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82 Jul 08 01:25:34 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:34 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e9507e49-f95c-4a84-afc6-01bf96198085 tempest-SnapshotDependencyTests-898400410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9" returned: 0 in 0.772s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:34 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-e9507e49-f95c-4a84-afc6-01bf96198085 tempest-SnapshotDependencyTests-898400410 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9 is being set with open permissions: ugo+rw Jul 08 01:25:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e9507e49-f95c-4a84-afc6-01bf96198085 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:34 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9 Jul 08 01:25:34 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:35 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-04f4c6df-2e26-4f59-9e4b-8f24af439af9 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82" returned: 0 in 0.849s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-04f4c6df-2e26-4f59-9e4b-8f24af439af9 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.fa4dfc28-07ed-45e5-a3e9-415944f3d6a5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:35 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.fa4dfc28-07ed-45e5-a3e9-415944f3d6a5 Jul 08 01:25:35 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:35 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e9507e49-f95c-4a84-afc6-01bf96198085 tempest-SnapshotDependencyTests-898400410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9" returned: 0 in 0.680s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e9507e49-f95c-4a84-afc6-01bf96198085 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:35 devstack sudo[106355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.info Jul 08 01:25:35 devstack sudo[106355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:35 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-04f4c6df-2e26-4f59-9e4b-8f24af439af9 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.fa4dfc28-07ed-45e5-a3e9-415944f3d6a5" returned: 0 in 0.778s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-04f4c6df-2e26-4f59-9e4b-8f24af439af9 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.fa4dfc28-07ed-45e5-a3e9-415944f3d6a5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:35 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.fa4dfc28-07ed-45e5-a3e9-415944f3d6a5 Jul 08 01:25:35 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:36 devstack sudo[106355]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e9507e49-f95c-4a84-afc6-01bf96198085 tempest-SnapshotDependencyTests-898400410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.info" returned: 0 in 0.712s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:36 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-e9507e49-f95c-4a84-afc6-01bf96198085 tempest-SnapshotDependencyTests-898400410 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.info is being set with open permissions: ugo+rw Jul 08 01:25:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e9507e49-f95c-4a84-afc6-01bf96198085 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:36 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.info Jul 08 01:25:36 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:36 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-04f4c6df-2e26-4f59-9e4b-8f24af439af9 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82.fa4dfc28-07ed-45e5-a3e9-415944f3d6a5" returned: 0 in 0.728s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:36 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-04f4c6df-2e26-4f59-9e4b-8f24af439af9 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-fa4dfc28-07ed-45e5-a3e9-415944f3d6a5" released by "_delete_snapshot" :: held 3.344s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:36 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-04f4c6df-2e26-4f59-9e4b-8f24af439af9 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-8890f0c1-7859-4995-b1e1-f0b03e7eee82" released by "delete_snapshot" :: held 3.392s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:36 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-04f4c6df-2e26-4f59-9e4b-8f24af439af9 tempest-ProjectMemberTests-1297668706 None] Created reservations ['0cdd412e-ccaa-49bf-8ad6-9d1e86d19f4a', '7d36f77e-7890-4894-b527-01231688f75d', 'c6280094-0682-4ca1-b36c-f80bc21d56f5', '06f06557-7358-4244-b7f7-ad50efa31022'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:36 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-04f4c6df-2e26-4f59-9e4b-8f24af439af9 tempest-ProjectMemberTests-1297668706 None] Delete snapshot completed successfully. Jul 08 01:25:36 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-04f4c6df-2e26-4f59-9e4b-8f24af439af9 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-fa4dfc28-07ed-45e5-a3e9-415944f3d6a5-delete_snapshot" released by "delete_snapshot" :: held 3.584s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:37 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e9507e49-f95c-4a84-afc6-01bf96198085 tempest-SnapshotDependencyTests-898400410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.info" returned: 0 in 0.738s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e9507e49-f95c-4a84-afc6-01bf96198085 tempest-SnapshotDependencyTests-898400410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.910s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:37 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-e9507e49-f95c-4a84-afc6-01bf96198085 tempest-SnapshotDependencyTests-898400410 None] Create snapshot completed successfully Jul 08 01:25:37 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b0307750-0862-4ea9-a0e5-89663ce60647 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-8890f0c1-7859-4995-b1e1-f0b03e7eee82-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:37 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b0307750-0862-4ea9-a0e5-89663ce60647 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-8890f0c1-7859-4995-b1e1-f0b03e7eee82-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:37 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b0307750-0862-4ea9-a0e5-89663ce60647 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-8890f0c1-7859-4995-b1e1-f0b03e7eee82" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:37 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b0307750-0862-4ea9-a0e5-89663ce60647 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-8890f0c1-7859-4995-b1e1-f0b03e7eee82" acquired by "delete_volume" :: waited 0.016s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:37 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35f40b9-0922-4c28-b34a-92ae16c708ae]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0307750-0862-4ea9-a0e5-89663ce60647 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:37 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82 Jul 08 01:25:37 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:UPDATE=180,cinder:SELECT=126,cinder:DELETE=15,cinder:INSERT=47 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=135,cinder:INSERT=46,cinder:UPDATE=188,cinder:DELETE=15 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Flow 'volume_create_manager' (37817ce9-660c-4059-b2e2-bdded660a21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc26389-f5e4-47e1-9d5d-971ae2dcd1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afc26389-f5e4-47e1-9d5d-971ae2dcd1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b067263-f92e-4fae-ae93-be5556c85d82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='73ab470f96ab4eb5a8f534af2ddddc82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=45a68a03-5058-4017-9e3f-a1a4bc8891b9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:38Z,use_quota=True,user_id='0040aa9a0825483ead24ba43e2e95560',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a39f8e8-952a-4d67-a3a3-e1a14eba7667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a39f8e8-952a-4d67-a3a3-e1a14eba7667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401f4b86-8f3e-4a75-afd3-598650d496fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (401f4b86-8f3e-4a75-afd3-598650d496fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2b067263-f92e-4fae-ae93-be5556c85d82', 'volume_name': 'volume-2b067263-f92e-4fae-ae93-be5556c85d82', 'volume_size': 1, 'snapshot_id': '45a68a03-5058-4017-9e3f-a1a4bc8891b9'}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3b2235-732b-4c34-ae2c-cade33a2ad58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3b2235-732b-4c34-ae2c-cade33a2ad58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2de87c9-c185-4d32-9951-d529aced8394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:38 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Volume 2b067263-f92e-4fae-ae93-be5556c85d82: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2b067263-f92e-4fae-ae93-be5556c85d82', 'volume_size': 1, 'snapshot_id': '45a68a03-5058-4017-9e3f-a1a4bc8891b9'} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Acquiring lock "cinder-quobyte-45a68a03-5058-4017-9e3f-a1a4bc8891b9-2b067263-f92e-4fae-ae93-be5556c85d82" by "_create_volume_from_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Lock "cinder-quobyte-45a68a03-5058-4017-9e3f-a1a4bc8891b9-2b067263-f92e-4fae-ae93-be5556c85d82" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Creating volume 2b067263-f92e-4fae-ae93-be5556c85d82 from snapshot 45a68a03-5058-4017-9e3f-a1a4bc8891b9 {{(pid=87123) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Acquiring lock "cinder-quobyte-2b067263-f92e-4fae-ae93-be5556c85d82" by "_copy_volume_from_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Lock "cinder-quobyte-2b067263-f92e-4fae-ae93-be5556c85d82" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] snapshot: 45a68a03-5058-4017-9e3f-a1a4bc8891b9, volume: 2b067263-f92e-4fae-ae93-be5556c85d82, {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 08 01:25:38 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0307750-0862-4ea9-a0e5-89663ce60647 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82" returned: 0 in 0.853s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0307750-0862-4ea9-a0e5-89663ce60647 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c14419-0d01-46da-8d90-67344b16dc44]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:38 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82 Jul 08 01:25:38 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:38 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9 Jul 08 01:25:38 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:39 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0307750-0862-4ea9-a0e5-89663ce60647 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-8890f0c1-7859-4995-b1e1-f0b03e7eee82" returned: 0 in 0.793s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b0307750-0862-4ea9-a0e5-89663ce60647 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-8890f0c1-7859-4995-b1e1-f0b03e7eee82" released by "delete_volume" :: held 1.721s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:39 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9" returned: 0 in 0.834s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:39 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:25:39 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 08 01:25:39 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Creating direct copy from snapshot {{(pid=87123) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 08 01:25:39 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-b0307750-0862-4ea9-a0e5-89663ce60647 tempest-ProjectMemberTests-1297668706 None] Created reservations ['6b64b2ee-b057-44db-86be-43f0022471c3', '10835687-bb5c-4baf-bf84-c6df4c20ed4d', 'd25b0a92-a992-4ed6-9483-4ece227359fb', '0daac0c0-d5e4-42c9-a4e8-eaceb0b0455c'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:39 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dbbdedd-6473-4354-aff4-d761e0b0d7a9]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b0307750-0862-4ea9-a0e5-89663ce60647 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b0307750-0862-4ea9-a0e5-89663ce60647 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:39 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b0307750-0862-4ea9-a0e5-89663ce60647 tempest-ProjectMemberTests-1297668706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:39 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b0307750-0862-4ea9-a0e5-89663ce60647 tempest-ProjectMemberTests-1297668706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b0307750-0862-4ea9-a0e5-89663ce60647 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0307750-0862-4ea9-a0e5-89663ce60647 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:39 devstack sudo[106377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 Jul 08 01:25:39 devstack sudo[106377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:39 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:25:39 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:40 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0307750-0862-4ea9-a0e5-89663ce60647 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.716s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:40 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-b0307750-0862-4ea9-a0e5-89663ce60647 tempest-ProjectMemberTests-1297668706 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:40 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b0307750-0862-4ea9-a0e5-89663ce60647 tempest-ProjectMemberTests-1297668706 None] Deleted volume successfully. Jul 08 01:25:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b0307750-0862-4ea9-a0e5-89663ce60647 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-8890f0c1-7859-4995-b1e1-f0b03e7eee82-delete_volume" released by "delete_volume" :: held 2.671s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:40 devstack sudo[106377]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6" returned: 0 in 0.851s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:40 devstack cinder-volume[87123]: DEBUG cinder.utils [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Path /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b067263-f92e-4fae-ae93-be5556c85d82 not found in is_blk_device check {{(pid=87123) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 08 01:25:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b067263-f92e-4fae-ae93-be5556c85d82 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:40 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b067263-f92e-4fae-ae93-be5556c85d82 Jul 08 01:25:40 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:40 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:25:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Flow 'volume_create_manager' (f1ee3610-5b6d-48b2-b15f-17eadc596d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588ecf00-6c12-4d9e-ad48-49f7042d66d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588ecf00-6c12-4d9e-ad48-49f7042d66d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-639716638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8fd4558-7f08-47a7-9aa0-138a166f2112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb446c86b7743258e78554d23b104d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:40Z,use_quota=True,user_id='c22268e4ddd34d8eb4bf4ae8a14331a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878dfcc1-7ff6-4c3d-866d-aa5db8e68326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878dfcc1-7ff6-4c3d-866d-aa5db8e68326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e1b261-7146-4a01-bf52-33f1108b8355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e1b261-7146-4a01-bf52-33f1108b8355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e8fd4558-7f08-47a7-9aa0-138a166f2112', 'volume_name': 'volume-e8fd4558-7f08-47a7-9aa0-138a166f2112', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c48c4c-837a-4ce8-9dd7-93a64e2c6493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c48c4c-837a-4ce8-9dd7-93a64e2c6493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:40 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e929f8b4-f0cc-4afd-a71f-cd11601f36b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:40 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Volume e8fd4558-7f08-47a7-9aa0-138a166f2112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e8fd4558-7f08-47a7-9aa0-138a166f2112', 'volume_size': 1} Jul 08 01:25:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:25:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:45 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:25:45 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:45 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b067263-f92e-4fae-ae93-be5556c85d82" returned: 0 in 4.978s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:45 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ef73dd-2866-4b97-8529-0357e8d328a3]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:45 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 Jul 08 01:25:45 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:45 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.705s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:45 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:45 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:25:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 28 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:25:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:25:46 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6" returned: 0 in 0.921s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:46 devstack cinder-volume[87123]: DEBUG cinder.image.image_utils [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Image conversion details: src /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6, size 1024.00 MB, duration 4.98 sec, destination /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b067263-f92e-4fae-ae93-be5556c85d82 {{(pid=87123) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 08 01:25:46 devstack cinder-volume[87123]: INFO cinder.image.image_utils [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Converted 1024.00 MB image at 205.64 MB/s Jul 08 01:25:46 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b067263-f92e-4fae-ae93-be5556c85d82 is being set with open permissions: ugo+rw Jul 08 01:25:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b067263-f92e-4fae-ae93-be5556c85d82 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:46 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b067263-f92e-4fae-ae93-be5556c85d82 Jul 08 01:25:46 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:46 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b067263-f92e-4fae-ae93-be5556c85d82" returned: 0 in 0.644s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Lock "cinder-quobyte-2b067263-f92e-4fae-ae93-be5556c85d82" released by "_copy_volume_from_snapshot" :: held 8.361s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Lock "cinder-quobyte-45a68a03-5058-4017-9e3f-a1a4bc8891b9-2b067263-f92e-4fae-ae93-be5556c85d82" released by "_create_volume_from_snapshot" :: held 8.401s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.418s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.426s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-639716638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e8fd4558-7f08-47a7-9aa0-138a166f2112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb446c86b7743258e78554d23b104d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:25:40Z,use_quota=True,user_id='c22268e4ddd34d8eb4bf4ae8a14331a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:25:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Creating volume e8fd4558-7f08-47a7-9aa0-138a166f2112 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:25:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:25:46 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:25:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:46 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112 1073741824 Jul 08 01:25:46 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2de87c9-c185-4d32-9951-d529aced8394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b067263-f92e-4fae-ae93-be5556c85d82', 'volume_size': 1, 'snapshot_id': '45a68a03-5058-4017-9e3f-a1a4bc8891b9'}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae8b636-f832-487e-b545-8e34f4409c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:46 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Volume volume-2b067263-f92e-4fae-ae93-be5556c85d82 (2b067263-f92e-4fae-ae93-be5556c85d82): created successfully Jul 08 01:25:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae8b636-f832-487e-b545-8e34f4409c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Flow 'volume_create_manager' (37817ce9-660c-4059-b2e2-bdded660a21f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:46 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-9794349b-f237-4aa7-9861-541b9d3a5c92 tempest-SnapshotDependencyTests-898400410 None] Created volume successfully. Jul 08 01:25:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-725e64f6-9202-41e2-b0ae-b1a31e592c67 tempest-SnapshotDependencyTests-898400410 None] Acquiring lock "cinder-45a68a03-5058-4017-9e3f-a1a4bc8891b9-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-725e64f6-9202-41e2-b0ae-b1a31e592c67 tempest-SnapshotDependencyTests-898400410 None] Lock "cinder-45a68a03-5058-4017-9e3f-a1a4bc8891b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-725e64f6-9202-41e2-b0ae-b1a31e592c67 tempest-SnapshotDependencyTests-898400410 None] Acquiring lock "cinder-quobyte-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-725e64f6-9202-41e2-b0ae-b1a31e592c67 tempest-SnapshotDependencyTests-898400410 None] Lock "cinder-quobyte-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-725e64f6-9202-41e2-b0ae-b1a31e592c67 tempest-SnapshotDependencyTests-898400410 None] Acquiring lock "cinder-quobyte-45a68a03-5058-4017-9e3f-a1a4bc8891b9" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-725e64f6-9202-41e2-b0ae-b1a31e592c67 tempest-SnapshotDependencyTests-898400410 None] Lock "cinder-quobyte-45a68a03-5058-4017-9e3f-a1a4bc8891b9" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-725e64f6-9202-41e2-b0ae-b1a31e592c67 tempest-SnapshotDependencyTests-898400410 None] Deleting offline snapshot 45a68a03-5058-4017-9e3f-a1a4bc8891b9 of volume d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:25:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-725e64f6-9202-41e2-b0ae-b1a31e592c67 tempest-SnapshotDependencyTests-898400410 None] snapshot_file for this snap is: volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:25:47 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8017bf-14c1-4124-98c7-a1afd204e21f]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-725e64f6-9202-41e2-b0ae-b1a31e592c67 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:47 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9 Jul 08 01:25:47 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:47 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112 1073741824" returned: 0 in 0.870s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:47 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112 Jul 08 01:25:47 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:48 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-725e64f6-9202-41e2-b0ae-b1a31e592c67 tempest-SnapshotDependencyTests-898400410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9" returned: 0 in 0.805s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-725e64f6-9202-41e2-b0ae-b1a31e592c67 tempest-SnapshotDependencyTests-898400410 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:25:48 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7fcbb8-586d-4e18-85d6-80a5a00cc134]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-725e64f6-9202-41e2-b0ae-b1a31e592c67 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:48 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112" returned: 0 in 0.669s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] <== create_volume: return (1580ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:25:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.583s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e929f8b4-f0cc-4afd-a71f-cd11601f36b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e8fd4558-7f08-47a7-9aa0-138a166f2112', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd35e07f-f4ce-4007-8102-7f30805898ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:25:48 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 Jul 08 01:25:48 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:48 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Volume volume-e8fd4558-7f08-47a7-9aa0-138a166f2112 (e8fd4558-7f08-47a7-9aa0-138a166f2112): created successfully Jul 08 01:25:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd35e07f-f4ce-4007-8102-7f30805898ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:25:48 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Flow 'volume_create_manager' (f1ee3610-5b6d-48b2-b15f-17eadc596d24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:25:48 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-ea24f9ab-c4d8-4489-9a48-8eb51e305ed9 tempest-ProjectMemberTests-1297668706 None] Created volume successfully. Jul 08 01:25:49 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-725e64f6-9202-41e2-b0ae-b1a31e592c67 tempest-SnapshotDependencyTests-898400410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6" returned: 0 in 0.815s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-725e64f6-9202-41e2-b0ae-b1a31e592c67 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:49 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9 Jul 08 01:25:49 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6471918a-adf5-42a1-95b8-9e76d9f5f53c tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6471918a-adf5-42a1-95b8-9e76d9f5f53c tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:49 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-6471918a-adf5-42a1-95b8-9e76d9f5f53c tempest-ProjectMemberTests-1297668706 None] Creating offline snapshot db9af16a-a90d-4b7e-9779-61f10d4237e5 of volume e8fd4558-7f08-47a7-9aa0-138a166f2112 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:25:49 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3f1a4d4-1fbc-4cc3-a71e-969e24838485]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6471918a-adf5-42a1-95b8-9e76d9f5f53c tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:49 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112 Jul 08 01:25:49 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:49 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-725e64f6-9202-41e2-b0ae-b1a31e592c67 tempest-SnapshotDependencyTests-898400410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9" returned: 0 in 0.816s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-725e64f6-9202-41e2-b0ae-b1a31e592c67 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:49 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9 Jul 08 01:25:49 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:50 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6471918a-adf5-42a1-95b8-9e76d9f5f53c tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112" returned: 0 in 0.824s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6471918a-adf5-42a1-95b8-9e76d9f5f53c tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.db9af16a-a90d-4b7e-9779-61f10d4237e5 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:50 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.db9af16a-a90d-4b7e-9779-61f10d4237e5 1G Jul 08 01:25:50 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:50 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-725e64f6-9202-41e2-b0ae-b1a31e592c67 tempest-SnapshotDependencyTests-898400410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6.45a68a03-5058-4017-9e3f-a1a4bc8891b9" returned: 0 in 0.710s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:50 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-725e64f6-9202-41e2-b0ae-b1a31e592c67 tempest-SnapshotDependencyTests-898400410 None] Lock "cinder-quobyte-45a68a03-5058-4017-9e3f-a1a4bc8891b9" released by "_delete_snapshot" :: held 3.255s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:50 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-725e64f6-9202-41e2-b0ae-b1a31e592c67 tempest-SnapshotDependencyTests-898400410 None] Lock "cinder-quobyte-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6" released by "delete_snapshot" :: held 3.279s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:50 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-725e64f6-9202-41e2-b0ae-b1a31e592c67 tempest-SnapshotDependencyTests-898400410 None] Created reservations ['17af9afa-b059-4080-b90f-57e89233e586', '1428a01b-96a9-43af-aa64-27f27cc7be0a', '74ce5201-6829-4164-b56c-407124a22d9d', 'a55b78b0-e9d0-41dc-b0c8-a7f0fcbe5881'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:50 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-725e64f6-9202-41e2-b0ae-b1a31e592c67 tempest-SnapshotDependencyTests-898400410 None] Delete snapshot completed successfully. Jul 08 01:25:50 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-725e64f6-9202-41e2-b0ae-b1a31e592c67 tempest-SnapshotDependencyTests-898400410 None] Lock "cinder-45a68a03-5058-4017-9e3f-a1a4bc8891b9-delete_snapshot" released by "delete_snapshot" :: held 3.427s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:50 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6471918a-adf5-42a1-95b8-9e76d9f5f53c tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.db9af16a-a90d-4b7e-9779-61f10d4237e5 1G" returned: 0 in 0.824s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6471918a-adf5-42a1-95b8-9e76d9f5f53c tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8fd4558-7f08-47a7-9aa0-138a166f2112 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.db9af16a-a90d-4b7e-9779-61f10d4237e5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:51 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8fd4558-7f08-47a7-9aa0-138a166f2112 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.db9af16a-a90d-4b7e-9779-61f10d4237e5 Jul 08 01:25:51 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:51 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-22d9f3fa-8f2c-4be4-bb9c-0da307e97776 tempest-SnapshotDependencyTests-898400410 None] Acquiring lock "cinder-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:51 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-22d9f3fa-8f2c-4be4-bb9c-0da307e97776 tempest-SnapshotDependencyTests-898400410 None] Lock "cinder-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:51 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-22d9f3fa-8f2c-4be4-bb9c-0da307e97776 tempest-SnapshotDependencyTests-898400410 None] Acquiring lock "cinder-quobyte-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:51 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-22d9f3fa-8f2c-4be4-bb9c-0da307e97776 tempest-SnapshotDependencyTests-898400410 None] Lock "cinder-quobyte-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6" acquired by "delete_volume" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:51 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[15cee6d4-2b0f-4028-be2a-41aa86fc7ffb]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-22d9f3fa-8f2c-4be4-bb9c-0da307e97776 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:51 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6471918a-adf5-42a1-95b8-9e76d9f5f53c tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e8fd4558-7f08-47a7-9aa0-138a166f2112 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.db9af16a-a90d-4b7e-9779-61f10d4237e5" returned: 0 in 0.761s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:51 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-6471918a-adf5-42a1-95b8-9e76d9f5f53c tempest-ProjectMemberTests-1297668706 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.db9af16a-a90d-4b7e-9779-61f10d4237e5 is being set with open permissions: ugo+rw Jul 08 01:25:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6471918a-adf5-42a1-95b8-9e76d9f5f53c tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.db9af16a-a90d-4b7e-9779-61f10d4237e5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:51 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.db9af16a-a90d-4b7e-9779-61f10d4237e5 Jul 08 01:25:51 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:51 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 Jul 08 01:25:51 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:52 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6471918a-adf5-42a1-95b8-9e76d9f5f53c tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.db9af16a-a90d-4b7e-9779-61f10d4237e5" returned: 0 in 0.653s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6471918a-adf5-42a1-95b8-9e76d9f5f53c tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:52 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.info Jul 08 01:25:52 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:52 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-22d9f3fa-8f2c-4be4-bb9c-0da307e97776 tempest-SnapshotDependencyTests-898400410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6" returned: 0 in 0.872s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-22d9f3fa-8f2c-4be4-bb9c-0da307e97776 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:52 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6 Jul 08 01:25:52 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:53 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6471918a-adf5-42a1-95b8-9e76d9f5f53c tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.info" returned: 0 in 0.694s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:53 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-6471918a-adf5-42a1-95b8-9e76d9f5f53c tempest-ProjectMemberTests-1297668706 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.info is being set with open permissions: ugo+rw Jul 08 01:25:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6471918a-adf5-42a1-95b8-9e76d9f5f53c tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:53 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.info Jul 08 01:25:53 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:53 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-22d9f3fa-8f2c-4be4-bb9c-0da307e97776 tempest-SnapshotDependencyTests-898400410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6" returned: 0 in 0.685s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-22d9f3fa-8f2c-4be4-bb9c-0da307e97776 tempest-SnapshotDependencyTests-898400410 None] Lock "cinder-quobyte-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6" released by "delete_volume" :: held 1.621s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:53 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-22d9f3fa-8f2c-4be4-bb9c-0da307e97776 tempest-SnapshotDependencyTests-898400410 None] Created reservations ['16a72c91-3a4b-4309-be11-1ad922715346', '55c56ee0-793a-48ed-8630-26612d9e222f', 'cfbe1809-66ba-43d9-a160-cff53c927a81', '2c0008ca-89ca-400b-a143-0a4bb595cb3a'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-22d9f3fa-8f2c-4be4-bb9c-0da307e97776 tempest-SnapshotDependencyTests-898400410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-22d9f3fa-8f2c-4be4-bb9c-0da307e97776 tempest-SnapshotDependencyTests-898400410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:53 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-22d9f3fa-8f2c-4be4-bb9c-0da307e97776 tempest-SnapshotDependencyTests-898400410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:53 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-22d9f3fa-8f2c-4be4-bb9c-0da307e97776 tempest-SnapshotDependencyTests-898400410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-22d9f3fa-8f2c-4be4-bb9c-0da307e97776 tempest-SnapshotDependencyTests-898400410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-22d9f3fa-8f2c-4be4-bb9c-0da307e97776 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:53 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:25:53 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:53 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6471918a-adf5-42a1-95b8-9e76d9f5f53c tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.info" returned: 0 in 0.652s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6471918a-adf5-42a1-95b8-9e76d9f5f53c tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.518s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-cf434eda-0a93-48b9-889a-c49313e5a8f0 tempest-SnapshotDependencyTests-898400410 None] Acquiring lock "cinder-2b067263-f92e-4fae-ae93-be5556c85d82-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-cf434eda-0a93-48b9-889a-c49313e5a8f0 tempest-SnapshotDependencyTests-898400410 None] Lock "cinder-2b067263-f92e-4fae-ae93-be5556c85d82-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:53 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-6471918a-adf5-42a1-95b8-9e76d9f5f53c tempest-ProjectMemberTests-1297668706 None] Create snapshot completed successfully Jul 08 01:25:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-cf434eda-0a93-48b9-889a-c49313e5a8f0 tempest-SnapshotDependencyTests-898400410 None] Acquiring lock "cinder-quobyte-2b067263-f92e-4fae-ae93-be5556c85d82" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-cf434eda-0a93-48b9-889a-c49313e5a8f0 tempest-SnapshotDependencyTests-898400410 None] Lock "cinder-quobyte-2b067263-f92e-4fae-ae93-be5556c85d82" acquired by "delete_volume" :: waited 0.013s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:53 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[034566d3-be47-485b-bde1-87dd765063bf]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cf434eda-0a93-48b9-889a-c49313e5a8f0 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b067263-f92e-4fae-ae93-be5556c85d82 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:54 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b067263-f92e-4fae-ae93-be5556c85d82 Jul 08 01:25:54 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:54 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-22d9f3fa-8f2c-4be4-bb9c-0da307e97776 tempest-SnapshotDependencyTests-898400410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.701s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:54 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-22d9f3fa-8f2c-4be4-bb9c-0da307e97776 tempest-SnapshotDependencyTests-898400410 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:54 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-22d9f3fa-8f2c-4be4-bb9c-0da307e97776 tempest-SnapshotDependencyTests-898400410 None] Deleted volume successfully. Jul 08 01:25:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-22d9f3fa-8f2c-4be4-bb9c-0da307e97776 tempest-SnapshotDependencyTests-898400410 None] Lock "cinder-d2f876d4-2651-4bc2-b1b8-d5d2c45deae6-delete_volume" released by "delete_volume" :: held 2.549s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fbc7a035-bc25-4882-883d-2245e5215939 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-db9af16a-a90d-4b7e-9779-61f10d4237e5-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fbc7a035-bc25-4882-883d-2245e5215939 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-db9af16a-a90d-4b7e-9779-61f10d4237e5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fbc7a035-bc25-4882-883d-2245e5215939 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-e8fd4558-7f08-47a7-9aa0-138a166f2112" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fbc7a035-bc25-4882-883d-2245e5215939 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-e8fd4558-7f08-47a7-9aa0-138a166f2112" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fbc7a035-bc25-4882-883d-2245e5215939 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-db9af16a-a90d-4b7e-9779-61f10d4237e5" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fbc7a035-bc25-4882-883d-2245e5215939 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-db9af16a-a90d-4b7e-9779-61f10d4237e5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-fbc7a035-bc25-4882-883d-2245e5215939 tempest-ProjectMemberTests-1297668706 None] Deleting offline snapshot db9af16a-a90d-4b7e-9779-61f10d4237e5 of volume e8fd4558-7f08-47a7-9aa0-138a166f2112 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:25:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-fbc7a035-bc25-4882-883d-2245e5215939 tempest-ProjectMemberTests-1297668706 None] snapshot_file for this snap is: volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.db9af16a-a90d-4b7e-9779-61f10d4237e5 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:25:54 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6d87c5-955b-4188-ba0a-85d8aaef8cff]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fbc7a035-bc25-4882-883d-2245e5215939 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.db9af16a-a90d-4b7e-9779-61f10d4237e5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:54 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.db9af16a-a90d-4b7e-9779-61f10d4237e5 Jul 08 01:25:54 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:54 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cf434eda-0a93-48b9-889a-c49313e5a8f0 tempest-SnapshotDependencyTests-898400410 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b067263-f92e-4fae-ae93-be5556c85d82" returned: 0 in 0.834s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cf434eda-0a93-48b9-889a-c49313e5a8f0 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b067263-f92e-4fae-ae93-be5556c85d82 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:54 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b067263-f92e-4fae-ae93-be5556c85d82 Jul 08 01:25:54 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:55 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cf434eda-0a93-48b9-889a-c49313e5a8f0 tempest-SnapshotDependencyTests-898400410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2b067263-f92e-4fae-ae93-be5556c85d82" returned: 0 in 0.688s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-cf434eda-0a93-48b9-889a-c49313e5a8f0 tempest-SnapshotDependencyTests-898400410 None] Lock "cinder-quobyte-2b067263-f92e-4fae-ae93-be5556c85d82" released by "delete_volume" :: held 1.567s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:55 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fbc7a035-bc25-4882-883d-2245e5215939 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.db9af16a-a90d-4b7e-9779-61f10d4237e5" returned: 0 in 0.878s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-fbc7a035-bc25-4882-883d-2245e5215939 tempest-ProjectMemberTests-1297668706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e8fd4558-7f08-47a7-9aa0-138a166f2112(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:25:55 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4bbac84-d188-4a8c-9179-e2de9828e391]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fbc7a035-bc25-4882-883d-2245e5215939 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:55 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-cf434eda-0a93-48b9-889a-c49313e5a8f0 tempest-SnapshotDependencyTests-898400410 None] Created reservations ['128573a2-9320-478a-ac57-5b9ff00ba626', 'c018b372-5343-4320-9e7e-0c70cdb1adab', '4cfc3f82-96ed-43cc-9115-dda7fcf8d130', '088b36ec-bb09-499d-8de6-1de3038fa222'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-cf434eda-0a93-48b9-889a-c49313e5a8f0 tempest-SnapshotDependencyTests-898400410 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:25:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-cf434eda-0a93-48b9-889a-c49313e5a8f0 tempest-SnapshotDependencyTests-898400410 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:25:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-cf434eda-0a93-48b9-889a-c49313e5a8f0 tempest-SnapshotDependencyTests-898400410 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:25:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-cf434eda-0a93-48b9-889a-c49313e5a8f0 tempest-SnapshotDependencyTests-898400410 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:25:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-cf434eda-0a93-48b9-889a-c49313e5a8f0 tempest-SnapshotDependencyTests-898400410 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:25:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cf434eda-0a93-48b9-889a-c49313e5a8f0 tempest-SnapshotDependencyTests-898400410 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:55 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112 Jul 08 01:25:55 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:55 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:25:55 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:56 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-cf434eda-0a93-48b9-889a-c49313e5a8f0 tempest-SnapshotDependencyTests-898400410 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.706s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:56 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-cf434eda-0a93-48b9-889a-c49313e5a8f0 tempest-SnapshotDependencyTests-898400410 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:25:56 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fbc7a035-bc25-4882-883d-2245e5215939 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112" returned: 0 in 0.813s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fbc7a035-bc25-4882-883d-2245e5215939 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.db9af16a-a90d-4b7e-9779-61f10d4237e5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:56 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-cf434eda-0a93-48b9-889a-c49313e5a8f0 tempest-SnapshotDependencyTests-898400410 None] Deleted volume successfully. Jul 08 01:25:56 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.db9af16a-a90d-4b7e-9779-61f10d4237e5 Jul 08 01:25:56 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-cf434eda-0a93-48b9-889a-c49313e5a8f0 tempest-SnapshotDependencyTests-898400410 None] Lock "cinder-2b067263-f92e-4fae-ae93-be5556c85d82-delete_volume" released by "delete_volume" :: held 2.547s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:57 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fbc7a035-bc25-4882-883d-2245e5215939 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.db9af16a-a90d-4b7e-9779-61f10d4237e5" returned: 0 in 0.790s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fbc7a035-bc25-4882-883d-2245e5215939 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.db9af16a-a90d-4b7e-9779-61f10d4237e5 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:57 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.db9af16a-a90d-4b7e-9779-61f10d4237e5 Jul 08 01:25:57 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:57 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fbc7a035-bc25-4882-883d-2245e5215939 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112.db9af16a-a90d-4b7e-9779-61f10d4237e5" returned: 0 in 0.714s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fbc7a035-bc25-4882-883d-2245e5215939 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-db9af16a-a90d-4b7e-9779-61f10d4237e5" released by "_delete_snapshot" :: held 3.302s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fbc7a035-bc25-4882-883d-2245e5215939 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-e8fd4558-7f08-47a7-9aa0-138a166f2112" released by "delete_snapshot" :: held 3.325s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:57 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-fbc7a035-bc25-4882-883d-2245e5215939 tempest-ProjectMemberTests-1297668706 None] Created reservations ['459334ff-5d7f-4de6-821a-6b46cc3cfae7', 'd1543f35-5cc7-4c78-aed1-c5eae92b6d10', '5595c540-8070-45db-9b4a-c5982dc0e05b', '66a0fffb-3e28-4b85-9446-e42a75579282'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:25:58 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-fbc7a035-bc25-4882-883d-2245e5215939 tempest-ProjectMemberTests-1297668706 None] Delete snapshot completed successfully. Jul 08 01:25:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-fbc7a035-bc25-4882-883d-2245e5215939 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-db9af16a-a90d-4b7e-9779-61f10d4237e5-delete_snapshot" released by "delete_snapshot" :: held 3.479s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:25:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a071b587-ebb7-440c-9ce4-b7ada09e4fb3 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-e8fd4558-7f08-47a7-9aa0-138a166f2112-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a071b587-ebb7-440c-9ce4-b7ada09e4fb3 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-e8fd4558-7f08-47a7-9aa0-138a166f2112-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a071b587-ebb7-440c-9ce4-b7ada09e4fb3 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-e8fd4558-7f08-47a7-9aa0-138a166f2112" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:25:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a071b587-ebb7-440c-9ce4-b7ada09e4fb3 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-e8fd4558-7f08-47a7-9aa0-138a166f2112" acquired by "delete_volume" :: waited 0.025s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:25:58 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbfec9c-80b8-4a72-92cf-30d3b3fcc048]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:25:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a071b587-ebb7-440c-9ce4-b7ada09e4fb3 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:59 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112 Jul 08 01:25:59 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:25:59 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 08 01:25:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a071b587-ebb7-440c-9ce4-b7ada09e4fb3 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112" returned: 0 in 0.842s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:25:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a071b587-ebb7-440c-9ce4-b7ada09e4fb3 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:25:59 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112 Jul 08 01:25:59 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:00 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a071b587-ebb7-440c-9ce4-b7ada09e4fb3 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-e8fd4558-7f08-47a7-9aa0-138a166f2112" returned: 0 in 0.787s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:00 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a071b587-ebb7-440c-9ce4-b7ada09e4fb3 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-e8fd4558-7f08-47a7-9aa0-138a166f2112" released by "delete_volume" :: held 1.725s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:00 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-a071b587-ebb7-440c-9ce4-b7ada09e4fb3 tempest-ProjectMemberTests-1297668706 None] Created reservations ['b23ebdb0-423c-4e4e-952b-55e48ae53ddb', 'c98fa4be-bb05-46fa-bd35-eb1f99e5672f', '7cb543c9-9649-4356-aeec-815879771b97', '7acfa7a8-6ae9-4d4f-a95d-962cec3d84c1'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a071b587-ebb7-440c-9ce4-b7ada09e4fb3 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a071b587-ebb7-440c-9ce4-b7ada09e4fb3 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a071b587-ebb7-440c-9ce4-b7ada09e4fb3 tempest-ProjectMemberTests-1297668706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a071b587-ebb7-440c-9ce4-b7ada09e4fb3 tempest-ProjectMemberTests-1297668706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a071b587-ebb7-440c-9ce4-b7ada09e4fb3 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a071b587-ebb7-440c-9ce4-b7ada09e4fb3 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:00 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:26:00 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:01 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a071b587-ebb7-440c-9ce4-b7ada09e4fb3 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.841s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-a071b587-ebb7-440c-9ce4-b7ada09e4fb3 tempest-ProjectMemberTests-1297668706 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Flow 'volume_create_manager' (6c4e0517-df7e-4806-979b-3c4be21ae3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9322bc12-99ee-4515-89ac-9d66d2369ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:01 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-a071b587-ebb7-440c-9ce4-b7ada09e4fb3 tempest-ProjectMemberTests-1297668706 None] Deleted volume successfully. Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9322bc12-99ee-4515-89ac-9d66d2369ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1471535387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b3ff64-8cb0-4f2e-baad-7e34ecf374fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb446c86b7743258e78554d23b104d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:02Z,use_quota=True,user_id='c22268e4ddd34d8eb4bf4ae8a14331a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762a6969-59f6-4998-ba79-0f0c1947eba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (762a6969-59f6-4998-ba79-0f0c1947eba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb59cc79-fca2-4291-a1d6-cb1cb6741ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb59cc79-fca2-4291-a1d6-cb1cb6741ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46b3ff64-8cb0-4f2e-baad-7e34ecf374fb', 'volume_name': 'volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a445933-d05d-40db-a5a0-06aef2dc98a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a445933-d05d-40db-a5a0-06aef2dc98a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d451dacf-e046-4f43-9b6b-397afa35496d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:01 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Volume 46b3ff64-8cb0-4f2e-baad-7e34ecf374fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb', 'volume_size': 1} Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1471535387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46b3ff64-8cb0-4f2e-baad-7e34ecf374fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb446c86b7743258e78554d23b104d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:02Z,use_quota=True,user_id='c22268e4ddd34d8eb4bf4ae8a14331a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Creating volume 46b3ff64-8cb0-4f2e-baad-7e34ecf374fb {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:26:01 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:01 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-a071b587-ebb7-440c-9ce4-b7ada09e4fb3 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-e8fd4558-7f08-47a7-9aa0-138a166f2112-delete_volume" released by "delete_volume" :: held 2.969s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:01 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb 1073741824 Jul 08 01:26:01 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:02 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb 1073741824" returned: 0 in 0.945s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:02 devstack sudo[106526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb Jul 08 01:26:02 devstack sudo[106526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:03 devstack sudo[106526]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb" returned: 0 in 0.767s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:03 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] <== create_volume: return (1762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:26:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.765s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:03 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d451dacf-e046-4f43-9b6b-397afa35496d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:03 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55407b0b-5333-4f55-906f-7444ec057da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:03 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Volume volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb (46b3ff64-8cb0-4f2e-baad-7e34ecf374fb): created successfully Jul 08 01:26:03 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55407b0b-5333-4f55-906f-7444ec057da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:03 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Flow 'volume_create_manager' (6c4e0517-df7e-4806-979b-3c4be21ae3e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:03 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-a86c20e9-92a2-4dc4-89d8-8372800faa4b tempest-ProjectMemberTests-1297668706 None] Created volume successfully. Jul 08 01:26:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2283705c-8fd9-4bae-b6ed-3c0ca5b13b13 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2283705c-8fd9-4bae-b6ed-3c0ca5b13b13 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:03 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-2283705c-8fd9-4bae-b6ed-3c0ca5b13b13 tempest-ProjectMemberTests-1297668706 None] Creating offline snapshot 93716675-4828-4f3b-aa1c-f9d259678cac of volume 46b3ff64-8cb0-4f2e-baad-7e34ecf374fb {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:26:03 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e6ae7f-17b1-4886-a768-dab17d7b6cec]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2283705c-8fd9-4bae-b6ed-3c0ca5b13b13 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:04 devstack sudo[106529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb Jul 08 01:26:04 devstack sudo[106529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:04 devstack sudo[106529]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2283705c-8fd9-4bae-b6ed-3c0ca5b13b13 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb" returned: 0 in 0.886s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2283705c-8fd9-4bae-b6ed-3c0ca5b13b13 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.93716675-4828-4f3b-aa1c-f9d259678cac 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:04 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.93716675-4828-4f3b-aa1c-f9d259678cac 1G Jul 08 01:26:04 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:05 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2283705c-8fd9-4bae-b6ed-3c0ca5b13b13 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.93716675-4828-4f3b-aa1c-f9d259678cac 1G" returned: 0 in 0.971s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2283705c-8fd9-4bae-b6ed-3c0ca5b13b13 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.93716675-4828-4f3b-aa1c-f9d259678cac {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:05 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.93716675-4828-4f3b-aa1c-f9d259678cac Jul 08 01:26:05 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:06 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2283705c-8fd9-4bae-b6ed-3c0ca5b13b13 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.93716675-4828-4f3b-aa1c-f9d259678cac" returned: 0 in 0.762s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:06 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-2283705c-8fd9-4bae-b6ed-3c0ca5b13b13 tempest-ProjectMemberTests-1297668706 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.93716675-4828-4f3b-aa1c-f9d259678cac is being set with open permissions: ugo+rw Jul 08 01:26:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2283705c-8fd9-4bae-b6ed-3c0ca5b13b13 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.93716675-4828-4f3b-aa1c-f9d259678cac {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:06 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.93716675-4828-4f3b-aa1c-f9d259678cac Jul 08 01:26:06 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:07 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2283705c-8fd9-4bae-b6ed-3c0ca5b13b13 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.93716675-4828-4f3b-aa1c-f9d259678cac" returned: 0 in 0.690s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2283705c-8fd9-4bae-b6ed-3c0ca5b13b13 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:07 devstack sudo[106550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.info Jul 08 01:26:07 devstack sudo[106550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:07 devstack sudo[106550]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2283705c-8fd9-4bae-b6ed-3c0ca5b13b13 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.info" returned: 0 in 0.677s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:07 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-2283705c-8fd9-4bae-b6ed-3c0ca5b13b13 tempest-ProjectMemberTests-1297668706 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.info is being set with open permissions: ugo+rw Jul 08 01:26:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2283705c-8fd9-4bae-b6ed-3c0ca5b13b13 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:08 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.info Jul 08 01:26:08 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:08 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-2283705c-8fd9-4bae-b6ed-3c0ca5b13b13 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.info" returned: 0 in 0.724s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-2283705c-8fd9-4bae-b6ed-3c0ca5b13b13 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.810s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:08 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-2283705c-8fd9-4bae-b6ed-3c0ca5b13b13 tempest-ProjectMemberTests-1297668706 None] Create snapshot completed successfully Jul 08 01:26:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5ac10381-9760-43cd-a1a1-7706466c1798 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-93716675-4828-4f3b-aa1c-f9d259678cac-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5ac10381-9760-43cd-a1a1-7706466c1798 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-93716675-4828-4f3b-aa1c-f9d259678cac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5ac10381-9760-43cd-a1a1-7706466c1798 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5ac10381-9760-43cd-a1a1-7706466c1798 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5ac10381-9760-43cd-a1a1-7706466c1798 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-93716675-4828-4f3b-aa1c-f9d259678cac" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5ac10381-9760-43cd-a1a1-7706466c1798 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-93716675-4828-4f3b-aa1c-f9d259678cac" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-5ac10381-9760-43cd-a1a1-7706466c1798 tempest-ProjectMemberTests-1297668706 None] Deleting offline snapshot 93716675-4828-4f3b-aa1c-f9d259678cac of volume 46b3ff64-8cb0-4f2e-baad-7e34ecf374fb {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:26:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-5ac10381-9760-43cd-a1a1-7706466c1798 tempest-ProjectMemberTests-1297668706 None] snapshot_file for this snap is: volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.93716675-4828-4f3b-aa1c-f9d259678cac {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:26:09 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[767abf84-9023-46bf-b34d-dd559a7e376b]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5ac10381-9760-43cd-a1a1-7706466c1798 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.93716675-4828-4f3b-aa1c-f9d259678cac {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:09 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.93716675-4828-4f3b-aa1c-f9d259678cac Jul 08 01:26:09 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:10 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5ac10381-9760-43cd-a1a1-7706466c1798 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.93716675-4828-4f3b-aa1c-f9d259678cac" returned: 0 in 0.811s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:10 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-5ac10381-9760-43cd-a1a1-7706466c1798 tempest-ProjectMemberTests-1297668706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:26:10 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[47dcbba2-25dc-4b4f-b3d1-91858c9659e6]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5ac10381-9760-43cd-a1a1-7706466c1798 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:10 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb Jul 08 01:26:10 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:10 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5ac10381-9760-43cd-a1a1-7706466c1798 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb" returned: 0 in 0.929s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5ac10381-9760-43cd-a1a1-7706466c1798 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.93716675-4828-4f3b-aa1c-f9d259678cac {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:11 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.93716675-4828-4f3b-aa1c-f9d259678cac Jul 08 01:26:11 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:11 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5ac10381-9760-43cd-a1a1-7706466c1798 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.93716675-4828-4f3b-aa1c-f9d259678cac" returned: 0 in 0.815s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5ac10381-9760-43cd-a1a1-7706466c1798 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.93716675-4828-4f3b-aa1c-f9d259678cac {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:11 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.93716675-4828-4f3b-aa1c-f9d259678cac Jul 08 01:26:11 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:12 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5ac10381-9760-43cd-a1a1-7706466c1798 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb.93716675-4828-4f3b-aa1c-f9d259678cac" returned: 0 in 0.685s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:12 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5ac10381-9760-43cd-a1a1-7706466c1798 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-93716675-4828-4f3b-aa1c-f9d259678cac" released by "_delete_snapshot" :: held 3.335s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:12 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5ac10381-9760-43cd-a1a1-7706466c1798 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb" released by "delete_snapshot" :: held 3.358s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:12 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-5ac10381-9760-43cd-a1a1-7706466c1798 tempest-ProjectMemberTests-1297668706 None] Created reservations ['272cad02-f527-413f-86a9-bd6b6328fbc2', 'c3864343-71a1-4966-8c9c-b5ba2959a475', 'fa2de2b9-3257-4712-afb1-357d50c2ad4f', '0a94fabb-727a-43b6-b6ca-72371534cc21'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:12 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-5ac10381-9760-43cd-a1a1-7706466c1798 tempest-ProjectMemberTests-1297668706 None] Delete snapshot completed successfully. Jul 08 01:26:12 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5ac10381-9760-43cd-a1a1-7706466c1798 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-93716675-4828-4f3b-aa1c-f9d259678cac-delete_snapshot" released by "delete_snapshot" :: held 3.523s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eeb7ada9-e9ec-4a73-9852-e6bd9190e016 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eeb7ada9-e9ec-4a73-9852-e6bd9190e016 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eeb7ada9-e9ec-4a73-9852-e6bd9190e016 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eeb7ada9-e9ec-4a73-9852-e6bd9190e016 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb" acquired by "delete_volume" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:13 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[29a4cdcf-a420-4f67-82a5-a35449ec193f]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eeb7ada9-e9ec-4a73-9852-e6bd9190e016 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:13 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb Jul 08 01:26:13 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:14 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eeb7ada9-e9ec-4a73-9852-e6bd9190e016 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb" returned: 0 in 0.846s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eeb7ada9-e9ec-4a73-9852-e6bd9190e016 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:14 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb Jul 08 01:26:14 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:15 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eeb7ada9-e9ec-4a73-9852-e6bd9190e016 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb" returned: 0 in 0.730s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:15 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eeb7ada9-e9ec-4a73-9852-e6bd9190e016 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb" released by "delete_volume" :: held 1.655s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:15 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-eeb7ada9-e9ec-4a73-9852-e6bd9190e016 tempest-ProjectMemberTests-1297668706 None] Created reservations ['63a588ed-f350-4f4c-96e3-bf6309fc64be', 'b555cb15-98bb-42bd-bd6b-a0719eaedd77', 'edc1a3eb-6baa-4720-a845-ea4d196cae27', 'a1689fdf-c37f-46c1-bad3-96b2a86ffe1e'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-eeb7ada9-e9ec-4a73-9852-e6bd9190e016 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-eeb7ada9-e9ec-4a73-9852-e6bd9190e016 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-eeb7ada9-e9ec-4a73-9852-e6bd9190e016 tempest-ProjectMemberTests-1297668706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-eeb7ada9-e9ec-4a73-9852-e6bd9190e016 tempest-ProjectMemberTests-1297668706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-eeb7ada9-e9ec-4a73-9852-e6bd9190e016 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eeb7ada9-e9ec-4a73-9852-e6bd9190e016 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:15 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:26:15 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:16 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eeb7ada9-e9ec-4a73-9852-e6bd9190e016 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.758s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-eeb7ada9-e9ec-4a73-9852-e6bd9190e016 tempest-ProjectMemberTests-1297668706 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:26:16 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-eeb7ada9-e9ec-4a73-9852-e6bd9190e016 tempest-ProjectMemberTests-1297668706 None] Deleted volume successfully. Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eeb7ada9-e9ec-4a73-9852-e6bd9190e016 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-46b3ff64-8cb0-4f2e-baad-7e34ecf374fb-delete_volume" released by "delete_volume" :: held 2.687s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Flow 'volume_create_manager' (6e0da861-f787-4ead-9213-a45182f28957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40352caa-32b9-4b87-b3f5-c7b28f1f90cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40352caa-32b9-4b87-b3f5-c7b28f1f90cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-107680422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da1a194-cc95-4c8f-9e02-e07d6e76a928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb446c86b7743258e78554d23b104d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:16Z,use_quota=True,user_id='c22268e4ddd34d8eb4bf4ae8a14331a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7223ee80-51bb-46a8-baa3-6d1abfa375af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7223ee80-51bb-46a8-baa3-6d1abfa375af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1891ad-581d-4eae-ab7f-75ec03cb8910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf1891ad-581d-4eae-ab7f-75ec03cb8910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3da1a194-cc95-4c8f-9e02-e07d6e76a928', 'volume_name': 'volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5577cec-0bf1-4dc1-9e4d-720107b7203f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5577cec-0bf1-4dc1-9e4d-720107b7203f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b3054e-a971-404e-aca5-af4fc63a2fda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:16 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Volume 3da1a194-cc95-4c8f-9e02-e07d6e76a928: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928', 'volume_size': 1} Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-107680422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3da1a194-cc95-4c8f-9e02-e07d6e76a928,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb446c86b7743258e78554d23b104d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:16Z,use_quota=True,user_id='c22268e4ddd34d8eb4bf4ae8a14331a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Creating volume 3da1a194-cc95-4c8f-9e02-e07d6e76a928 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:26:16 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:26:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:16 devstack sudo[106587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928 1073741824 Jul 08 01:26:16 devstack sudo[106587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:17 devstack sudo[106587]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928 1073741824" returned: 0 in 0.866s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:17 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928 Jul 08 01:26:17 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:17 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928" returned: 0 in 0.669s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:26:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (07b3054e-a971-404e-aca5-af4fc63a2fda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e626d5-fcba-4e93-a0bf-0014f124f382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:17 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Volume volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928 (3da1a194-cc95-4c8f-9e02-e07d6e76a928): created successfully Jul 08 01:26:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e626d5-fcba-4e93-a0bf-0014f124f382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Flow 'volume_create_manager' (6e0da861-f787-4ead-9213-a45182f28957) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:17 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b20364ad-eead-4e3f-bb4c-0080fbf80fa1 tempest-ProjectMemberTests-1297668706 None] Created volume successfully. Jul 08 01:26:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-85241be4-b331-43fb-89c3-2385853ef96f tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-85241be4-b331-43fb-89c3-2385853ef96f tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-85241be4-b331-43fb-89c3-2385853ef96f tempest-ProjectMemberTests-1297668706 None] Creating offline snapshot bcd78897-13a2-443a-9f53-4b3977294c5d of volume 3da1a194-cc95-4c8f-9e02-e07d6e76a928 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:26:18 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[7725b504-2b78-4c38-8841-c4189decc830]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-85241be4-b331-43fb-89c3-2385853ef96f tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:18 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928 Jul 08 01:26:18 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:19 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-85241be4-b331-43fb-89c3-2385853ef96f tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928" returned: 0 in 0.771s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-85241be4-b331-43fb-89c3-2385853ef96f tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.bcd78897-13a2-443a-9f53-4b3977294c5d 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:19 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.bcd78897-13a2-443a-9f53-4b3977294c5d 1G Jul 08 01:26:19 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:20 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-85241be4-b331-43fb-89c3-2385853ef96f tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.bcd78897-13a2-443a-9f53-4b3977294c5d 1G" returned: 0 in 0.858s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-85241be4-b331-43fb-89c3-2385853ef96f tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.bcd78897-13a2-443a-9f53-4b3977294c5d {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:20 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.bcd78897-13a2-443a-9f53-4b3977294c5d Jul 08 01:26:20 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:20 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-85241be4-b331-43fb-89c3-2385853ef96f tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.bcd78897-13a2-443a-9f53-4b3977294c5d" returned: 0 in 0.731s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:20 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-85241be4-b331-43fb-89c3-2385853ef96f tempest-ProjectMemberTests-1297668706 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.bcd78897-13a2-443a-9f53-4b3977294c5d is being set with open permissions: ugo+rw Jul 08 01:26:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-85241be4-b331-43fb-89c3-2385853ef96f tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.bcd78897-13a2-443a-9f53-4b3977294c5d {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:20 devstack sudo[106612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.bcd78897-13a2-443a-9f53-4b3977294c5d Jul 08 01:26:20 devstack sudo[106612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:21 devstack sudo[106612]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-85241be4-b331-43fb-89c3-2385853ef96f tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.bcd78897-13a2-443a-9f53-4b3977294c5d" returned: 0 in 0.657s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-85241be4-b331-43fb-89c3-2385853ef96f tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:21 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.info Jul 08 01:26:21 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:22 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-85241be4-b331-43fb-89c3-2385853ef96f tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.info" returned: 0 in 0.689s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:22 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-85241be4-b331-43fb-89c3-2385853ef96f tempest-ProjectMemberTests-1297668706 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.info is being set with open permissions: ugo+rw Jul 08 01:26:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-85241be4-b331-43fb-89c3-2385853ef96f tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:22 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.info Jul 08 01:26:22 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:22 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-85241be4-b331-43fb-89c3-2385853ef96f tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.info" returned: 0 in 0.667s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-85241be4-b331-43fb-89c3-2385853ef96f tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.464s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:23 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-85241be4-b331-43fb-89c3-2385853ef96f tempest-ProjectMemberTests-1297668706 None] Create snapshot completed successfully Jul 08 01:26:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b0a97df2-24fa-4fe4-aa40-4e6d24ea2ce2 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-bcd78897-13a2-443a-9f53-4b3977294c5d-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b0a97df2-24fa-4fe4-aa40-4e6d24ea2ce2 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-bcd78897-13a2-443a-9f53-4b3977294c5d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b0a97df2-24fa-4fe4-aa40-4e6d24ea2ce2 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-3da1a194-cc95-4c8f-9e02-e07d6e76a928" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b0a97df2-24fa-4fe4-aa40-4e6d24ea2ce2 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-3da1a194-cc95-4c8f-9e02-e07d6e76a928" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b0a97df2-24fa-4fe4-aa40-4e6d24ea2ce2 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-bcd78897-13a2-443a-9f53-4b3977294c5d" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:23 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b0a97df2-24fa-4fe4-aa40-4e6d24ea2ce2 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-bcd78897-13a2-443a-9f53-4b3977294c5d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-b0a97df2-24fa-4fe4-aa40-4e6d24ea2ce2 tempest-ProjectMemberTests-1297668706 None] Deleting offline snapshot bcd78897-13a2-443a-9f53-4b3977294c5d of volume 3da1a194-cc95-4c8f-9e02-e07d6e76a928 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:26:23 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-b0a97df2-24fa-4fe4-aa40-4e6d24ea2ce2 tempest-ProjectMemberTests-1297668706 None] snapshot_file for this snap is: volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.bcd78897-13a2-443a-9f53-4b3977294c5d {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:26:23 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fa1031-15e7-406d-8782-4eed76fe6c6b]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0a97df2-24fa-4fe4-aa40-4e6d24ea2ce2 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.bcd78897-13a2-443a-9f53-4b3977294c5d {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:23 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.bcd78897-13a2-443a-9f53-4b3977294c5d Jul 08 01:26:23 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:24 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0a97df2-24fa-4fe4-aa40-4e6d24ea2ce2 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.bcd78897-13a2-443a-9f53-4b3977294c5d" returned: 0 in 0.754s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-b0a97df2-24fa-4fe4-aa40-4e6d24ea2ce2 tempest-ProjectMemberTests-1297668706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:26:24 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd045a0a-30a7-4514-88e8-4bc7e6f943bb]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0a97df2-24fa-4fe4-aa40-4e6d24ea2ce2 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:24 devstack sudo[106670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928 Jul 08 01:26:24 devstack sudo[106670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:25 devstack sudo[106670]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0a97df2-24fa-4fe4-aa40-4e6d24ea2ce2 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928" returned: 0 in 0.765s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0a97df2-24fa-4fe4-aa40-4e6d24ea2ce2 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.bcd78897-13a2-443a-9f53-4b3977294c5d {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:25 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.bcd78897-13a2-443a-9f53-4b3977294c5d Jul 08 01:26:25 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:26 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0a97df2-24fa-4fe4-aa40-4e6d24ea2ce2 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.bcd78897-13a2-443a-9f53-4b3977294c5d" returned: 0 in 0.752s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0a97df2-24fa-4fe4-aa40-4e6d24ea2ce2 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.bcd78897-13a2-443a-9f53-4b3977294c5d {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:26 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.bcd78897-13a2-443a-9f53-4b3977294c5d Jul 08 01:26:26 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:26 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b0a97df2-24fa-4fe4-aa40-4e6d24ea2ce2 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928.bcd78897-13a2-443a-9f53-4b3977294c5d" returned: 0 in 0.693s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b0a97df2-24fa-4fe4-aa40-4e6d24ea2ce2 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-bcd78897-13a2-443a-9f53-4b3977294c5d" released by "_delete_snapshot" :: held 3.054s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b0a97df2-24fa-4fe4-aa40-4e6d24ea2ce2 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-3da1a194-cc95-4c8f-9e02-e07d6e76a928" released by "delete_snapshot" :: held 3.079s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:26 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-b0a97df2-24fa-4fe4-aa40-4e6d24ea2ce2 tempest-ProjectMemberTests-1297668706 None] Created reservations ['a303fa0e-03b1-47f8-8607-a0fd6b08f95d', 'bfb91765-48cc-4f7b-aedd-143100c302a0', 'ed465ca9-cadd-4248-9093-6c3d98a998e0', 'a3db0dc7-c654-47b4-9ca1-b63c6ecb078c'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:26 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b0a97df2-24fa-4fe4-aa40-4e6d24ea2ce2 tempest-ProjectMemberTests-1297668706 None] Delete snapshot completed successfully. Jul 08 01:26:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b0a97df2-24fa-4fe4-aa40-4e6d24ea2ce2 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-bcd78897-13a2-443a-9f53-4b3977294c5d-delete_snapshot" released by "delete_snapshot" :: held 3.228s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:27 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1c7dfa17-4f44-4f0e-a712-73e062a37c44 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-3da1a194-cc95-4c8f-9e02-e07d6e76a928-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:27 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1c7dfa17-4f44-4f0e-a712-73e062a37c44 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-3da1a194-cc95-4c8f-9e02-e07d6e76a928-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1c7dfa17-4f44-4f0e-a712-73e062a37c44 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-3da1a194-cc95-4c8f-9e02-e07d6e76a928" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1c7dfa17-4f44-4f0e-a712-73e062a37c44 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-3da1a194-cc95-4c8f-9e02-e07d6e76a928" acquired by "delete_volume" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:28 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff505e8-55f8-46da-b148-9bd5739fdd33]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c7dfa17-4f44-4f0e-a712-73e062a37c44 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:28 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928 Jul 08 01:26:28 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:28 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c7dfa17-4f44-4f0e-a712-73e062a37c44 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928" returned: 0 in 0.803s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c7dfa17-4f44-4f0e-a712-73e062a37c44 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:28 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928 Jul 08 01:26:28 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:29 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c7dfa17-4f44-4f0e-a712-73e062a37c44 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3da1a194-cc95-4c8f-9e02-e07d6e76a928" returned: 0 in 0.652s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:29 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1c7dfa17-4f44-4f0e-a712-73e062a37c44 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-3da1a194-cc95-4c8f-9e02-e07d6e76a928" released by "delete_volume" :: held 1.515s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:29 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-1c7dfa17-4f44-4f0e-a712-73e062a37c44 tempest-ProjectMemberTests-1297668706 None] Created reservations ['e3fe16e5-42fe-4510-9ccf-efd110cbbd0e', '00feaaaa-42fb-433c-a080-5ac603be1ed9', '9d2c5ac0-34eb-4fb1-ac7b-21e5bee5a769', '6d61afeb-21f9-4324-8377-11a2b43a3728'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c7dfa17-4f44-4f0e-a712-73e062a37c44 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c7dfa17-4f44-4f0e-a712-73e062a37c44 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:29 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1c7dfa17-4f44-4f0e-a712-73e062a37c44 tempest-ProjectMemberTests-1297668706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:29 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1c7dfa17-4f44-4f0e-a712-73e062a37c44 tempest-ProjectMemberTests-1297668706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1c7dfa17-4f44-4f0e-a712-73e062a37c44 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c7dfa17-4f44-4f0e-a712-73e062a37c44 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:29 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:26:29 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:30 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1c7dfa17-4f44-4f0e-a712-73e062a37c44 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.701s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-1c7dfa17-4f44-4f0e-a712-73e062a37c44 tempest-ProjectMemberTests-1297668706 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:26:30 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-1c7dfa17-4f44-4f0e-a712-73e062a37c44 tempest-ProjectMemberTests-1297668706 None] Deleted volume successfully. Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1c7dfa17-4f44-4f0e-a712-73e062a37c44 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-3da1a194-cc95-4c8f-9e02-e07d6e76a928-delete_volume" released by "delete_volume" :: held 2.440s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Flow 'volume_create_manager' (d7f42072-2ed5-4eed-b4d3-9c144aac44b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c62f91a0-760d-49c4-b053-d74dc3082df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c62f91a0-760d-49c4-b053-d74dc3082df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1632147982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd76862c-0c26-498b-a857-65483259a89e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb446c86b7743258e78554d23b104d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:31Z,use_quota=True,user_id='c22268e4ddd34d8eb4bf4ae8a14331a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6181db09-1b4e-44da-a224-5e3f2b1839d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6181db09-1b4e-44da-a224-5e3f2b1839d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90848113-a53e-44da-be56-af1aa9c294d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90848113-a53e-44da-be56-af1aa9c294d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd76862c-0c26-498b-a857-65483259a89e', 'volume_name': 'volume-dd76862c-0c26-498b-a857-65483259a89e', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65004723-7f5d-4738-9a20-bfc550d3909c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65004723-7f5d-4738-9a20-bfc550d3909c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b755e35e-e647-4ee9-b180-195fa00647a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:30 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Volume dd76862c-0c26-498b-a857-65483259a89e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd76862c-0c26-498b-a857-65483259a89e', 'volume_size': 1} Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1632147982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd76862c-0c26-498b-a857-65483259a89e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb446c86b7743258e78554d23b104d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:31Z,use_quota=True,user_id='c22268e4ddd34d8eb4bf4ae8a14331a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Creating volume dd76862c-0c26-498b-a857-65483259a89e {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:26:30 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:26:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:30 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e 1073741824 Jul 08 01:26:30 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:31 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e 1073741824" returned: 0 in 0.860s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:31 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e Jul 08 01:26:31 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:32 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e" returned: 0 in 0.791s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] <== create_volume: return (1697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:26:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b755e35e-e647-4ee9-b180-195fa00647a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd76862c-0c26-498b-a857-65483259a89e', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69159b2-3021-49f7-a5b7-af590d480943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:32 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Volume volume-dd76862c-0c26-498b-a857-65483259a89e (dd76862c-0c26-498b-a857-65483259a89e): created successfully Jul 08 01:26:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b69159b2-3021-49f7-a5b7-af590d480943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Flow 'volume_create_manager' (d7f42072-2ed5-4eed-b4d3-9c144aac44b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:32 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-78061435-88a9-44a1-b484-6e4865bb20d6 tempest-ProjectMemberTests-1297668706 None] Created volume successfully. Jul 08 01:26:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c3adea18-fbc9-4873-bd90-b10524a8982e tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c3adea18-fbc9-4873-bd90-b10524a8982e tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-c3adea18-fbc9-4873-bd90-b10524a8982e tempest-ProjectMemberTests-1297668706 None] Creating offline snapshot 094d05c1-a490-4aa6-9f06-bf9d21c2a8ce of volume dd76862c-0c26-498b-a857-65483259a89e {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:26:32 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a80b32-2b1f-429b-a165-9fce2764f6b2]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c3adea18-fbc9-4873-bd90-b10524a8982e tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:33 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e Jul 08 01:26:33 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:33 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c3adea18-fbc9-4873-bd90-b10524a8982e tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e" returned: 0 in 0.800s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c3adea18-fbc9-4873-bd90-b10524a8982e tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.094d05c1-a490-4aa6-9f06-bf9d21c2a8ce 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:33 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.094d05c1-a490-4aa6-9f06-bf9d21c2a8ce 1G Jul 08 01:26:33 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:34 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c3adea18-fbc9-4873-bd90-b10524a8982e tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.094d05c1-a490-4aa6-9f06-bf9d21c2a8ce 1G" returned: 0 in 0.851s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c3adea18-fbc9-4873-bd90-b10524a8982e tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd76862c-0c26-498b-a857-65483259a89e -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.094d05c1-a490-4aa6-9f06-bf9d21c2a8ce {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:34 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd76862c-0c26-498b-a857-65483259a89e -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.094d05c1-a490-4aa6-9f06-bf9d21c2a8ce Jul 08 01:26:34 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:35 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c3adea18-fbc9-4873-bd90-b10524a8982e tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dd76862c-0c26-498b-a857-65483259a89e -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.094d05c1-a490-4aa6-9f06-bf9d21c2a8ce" returned: 0 in 0.726s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:35 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-c3adea18-fbc9-4873-bd90-b10524a8982e tempest-ProjectMemberTests-1297668706 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.094d05c1-a490-4aa6-9f06-bf9d21c2a8ce is being set with open permissions: ugo+rw Jul 08 01:26:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c3adea18-fbc9-4873-bd90-b10524a8982e tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.094d05c1-a490-4aa6-9f06-bf9d21c2a8ce {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:35 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.094d05c1-a490-4aa6-9f06-bf9d21c2a8ce Jul 08 01:26:35 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:36 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c3adea18-fbc9-4873-bd90-b10524a8982e tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.094d05c1-a490-4aa6-9f06-bf9d21c2a8ce" returned: 0 in 0.722s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c3adea18-fbc9-4873-bd90-b10524a8982e tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:36 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.info Jul 08 01:26:36 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:36 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c3adea18-fbc9-4873-bd90-b10524a8982e tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.info" returned: 0 in 0.707s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:36 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-c3adea18-fbc9-4873-bd90-b10524a8982e tempest-ProjectMemberTests-1297668706 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.info is being set with open permissions: ugo+rw Jul 08 01:26:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c3adea18-fbc9-4873-bd90-b10524a8982e tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:36 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.info Jul 08 01:26:36 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:37 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c3adea18-fbc9-4873-bd90-b10524a8982e tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.info" returned: 0 in 0.706s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c3adea18-fbc9-4873-bd90-b10524a8982e tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.605s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:37 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-c3adea18-fbc9-4873-bd90-b10524a8982e tempest-ProjectMemberTests-1297668706 None] Create snapshot completed successfully Jul 08 01:26:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-19234a99-2589-498d-95c3-7bbb62a2dded tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-094d05c1-a490-4aa6-9f06-bf9d21c2a8ce-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-19234a99-2589-498d-95c3-7bbb62a2dded tempest-ProjectMemberTests-1297668706 None] Lock "cinder-094d05c1-a490-4aa6-9f06-bf9d21c2a8ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-19234a99-2589-498d-95c3-7bbb62a2dded tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-dd76862c-0c26-498b-a857-65483259a89e" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-19234a99-2589-498d-95c3-7bbb62a2dded tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-dd76862c-0c26-498b-a857-65483259a89e" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-19234a99-2589-498d-95c3-7bbb62a2dded tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-094d05c1-a490-4aa6-9f06-bf9d21c2a8ce" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:38 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-19234a99-2589-498d-95c3-7bbb62a2dded tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-094d05c1-a490-4aa6-9f06-bf9d21c2a8ce" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-19234a99-2589-498d-95c3-7bbb62a2dded tempest-ProjectMemberTests-1297668706 None] Deleting offline snapshot 094d05c1-a490-4aa6-9f06-bf9d21c2a8ce of volume dd76862c-0c26-498b-a857-65483259a89e {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:26:38 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-19234a99-2589-498d-95c3-7bbb62a2dded tempest-ProjectMemberTests-1297668706 None] snapshot_file for this snap is: volume-dd76862c-0c26-498b-a857-65483259a89e.094d05c1-a490-4aa6-9f06-bf9d21c2a8ce {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:26:38 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea92b0b-997f-49d9-bc67-c637b402f896]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-19234a99-2589-498d-95c3-7bbb62a2dded tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.094d05c1-a490-4aa6-9f06-bf9d21c2a8ce {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:38 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.094d05c1-a490-4aa6-9f06-bf9d21c2a8ce Jul 08 01:26:38 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:39 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-19234a99-2589-498d-95c3-7bbb62a2dded tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.094d05c1-a490-4aa6-9f06-bf9d21c2a8ce" returned: 0 in 0.832s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:39 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-19234a99-2589-498d-95c3-7bbb62a2dded tempest-ProjectMemberTests-1297668706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dd76862c-0c26-498b-a857-65483259a89e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:26:39 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7f8dfe3-de55-401b-90d1-75bf0b0e8ce1]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-19234a99-2589-498d-95c3-7bbb62a2dded tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:39 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e Jul 08 01:26:39 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:40 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-19234a99-2589-498d-95c3-7bbb62a2dded tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e" returned: 0 in 0.894s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-19234a99-2589-498d-95c3-7bbb62a2dded tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.094d05c1-a490-4aa6-9f06-bf9d21c2a8ce {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:40 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.094d05c1-a490-4aa6-9f06-bf9d21c2a8ce Jul 08 01:26:40 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:40 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-19234a99-2589-498d-95c3-7bbb62a2dded tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.094d05c1-a490-4aa6-9f06-bf9d21c2a8ce" returned: 0 in 0.835s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-19234a99-2589-498d-95c3-7bbb62a2dded tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.094d05c1-a490-4aa6-9f06-bf9d21c2a8ce {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:40 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.094d05c1-a490-4aa6-9f06-bf9d21c2a8ce Jul 08 01:26:40 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:41 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-19234a99-2589-498d-95c3-7bbb62a2dded tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e.094d05c1-a490-4aa6-9f06-bf9d21c2a8ce" returned: 0 in 0.752s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:41 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-19234a99-2589-498d-95c3-7bbb62a2dded tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-094d05c1-a490-4aa6-9f06-bf9d21c2a8ce" released by "_delete_snapshot" :: held 3.423s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:41 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-19234a99-2589-498d-95c3-7bbb62a2dded tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-dd76862c-0c26-498b-a857-65483259a89e" released by "delete_snapshot" :: held 3.452s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:41 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=67,cinder:INSERT=23,cinder:UPDATE=93,cinder:DELETE=6 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:26:41 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=71,cinder:INSERT=25,cinder:UPDATE=85,cinder:DELETE=9 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:26:41 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-19234a99-2589-498d-95c3-7bbb62a2dded tempest-ProjectMemberTests-1297668706 None] Created reservations ['0ae9bc96-37a9-445a-8af4-c6609b4c4711', '1bacb5f1-49dd-49cf-8efe-8b5d36ccb2c5', '6ffeba3c-4d13-4694-b457-f7bb0eee86fa', '8cf67ef8-02e4-448c-aba2-8d1666b5ba32'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:41 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-19234a99-2589-498d-95c3-7bbb62a2dded tempest-ProjectMemberTests-1297668706 None] Delete snapshot completed successfully. Jul 08 01:26:41 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-19234a99-2589-498d-95c3-7bbb62a2dded tempest-ProjectMemberTests-1297668706 None] Lock "cinder-094d05c1-a490-4aa6-9f06-bf9d21c2a8ce-delete_snapshot" released by "delete_snapshot" :: held 3.628s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:42 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6c423355-8215-446b-aff9-7997755634ee tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-dd76862c-0c26-498b-a857-65483259a89e-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:42 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6c423355-8215-446b-aff9-7997755634ee tempest-ProjectMemberTests-1297668706 None] Lock "cinder-dd76862c-0c26-498b-a857-65483259a89e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:42 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6c423355-8215-446b-aff9-7997755634ee tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-dd76862c-0c26-498b-a857-65483259a89e" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:42 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6c423355-8215-446b-aff9-7997755634ee tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-dd76862c-0c26-498b-a857-65483259a89e" acquired by "delete_volume" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:42 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c3e0ed-135f-4c50-9988-e716b23a86a7]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6c423355-8215-446b-aff9-7997755634ee tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:42 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e Jul 08 01:26:42 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:43 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6c423355-8215-446b-aff9-7997755634ee tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e" returned: 0 in 0.813s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6c423355-8215-446b-aff9-7997755634ee tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:43 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e Jul 08 01:26:43 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:44 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6c423355-8215-446b-aff9-7997755634ee tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-dd76862c-0c26-498b-a857-65483259a89e" returned: 0 in 0.711s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:44 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6c423355-8215-446b-aff9-7997755634ee tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-dd76862c-0c26-498b-a857-65483259a89e" released by "delete_volume" :: held 1.596s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:44 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-6c423355-8215-446b-aff9-7997755634ee tempest-ProjectMemberTests-1297668706 None] Created reservations ['8afa074b-63f1-4747-8981-3d1ee686b2c9', '695862e6-32b1-4fcb-91fd-b2cdb6cebc09', 'c75f72cb-e073-4164-8dda-8bef1693a100', '774ccf13-c817-45ae-9bb9-077800db0a9f'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6c423355-8215-446b-aff9-7997755634ee tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6c423355-8215-446b-aff9-7997755634ee tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6c423355-8215-446b-aff9-7997755634ee tempest-ProjectMemberTests-1297668706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-6c423355-8215-446b-aff9-7997755634ee tempest-ProjectMemberTests-1297668706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-6c423355-8215-446b-aff9-7997755634ee tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6c423355-8215-446b-aff9-7997755634ee tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:44 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:26:44 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:26:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:44 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:26:44 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:45 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-6c423355-8215-446b-aff9-7997755634ee tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.746s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-6c423355-8215-446b-aff9-7997755634ee tempest-ProjectMemberTests-1297668706 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:26:45 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-6c423355-8215-446b-aff9-7997755634ee tempest-ProjectMemberTests-1297668706 None] Deleted volume successfully. Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-6c423355-8215-446b-aff9-7997755634ee tempest-ProjectMemberTests-1297668706 None] Lock "cinder-dd76862c-0c26-498b-a857-65483259a89e-delete_volume" released by "delete_volume" :: held 2.604s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Flow 'volume_create_manager' (0d285d7a-10e3-4cca-ad04-648730d0c60d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f4f3b5-c8cf-4f22-9acd-976a158cf4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f4f3b5-c8cf-4f22-9acd-976a158cf4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-723140487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598db3c9-c85c-4326-9eef-c7cc60ffb2ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb446c86b7743258e78554d23b104d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:45Z,use_quota=True,user_id='c22268e4ddd34d8eb4bf4ae8a14331a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e018c6-81af-48d8-ad09-aa679e9510bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0e018c6-81af-48d8-ad09-aa679e9510bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e77a358-c54f-438b-ac18-3b738b8877ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e77a358-c54f-438b-ac18-3b738b8877ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '598db3c9-c85c-4326-9eef-c7cc60ffb2ba', 'volume_name': 'volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c9d676-ef11-40db-9852-9004f7550cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c9d676-ef11-40db-9852-9004f7550cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6909f9-7639-47af-86d0-b7c97e88bdcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:45 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Volume 598db3c9-c85c-4326-9eef-c7cc60ffb2ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba', 'volume_size': 1} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-723140487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598db3c9-c85c-4326-9eef-c7cc60ffb2ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb446c86b7743258e78554d23b104d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:26:45Z,use_quota=True,user_id='c22268e4ddd34d8eb4bf4ae8a14331a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Creating volume 598db3c9-c85c-4326-9eef-c7cc60ffb2ba {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:26:45 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:45 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba 1073741824 Jul 08 01:26:45 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:45 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.770s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 28 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:26:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:26:46 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba 1073741824" returned: 0 in 0.812s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:46 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba Jul 08 01:26:46 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:46 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba" returned: 0 in 0.621s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:26:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc6909f9-7639-47af-86d0-b7c97e88bdcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eccc24e4-0383-418c-a068-465ed3121a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:46 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Volume volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba (598db3c9-c85c-4326-9eef-c7cc60ffb2ba): created successfully Jul 08 01:26:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eccc24e4-0383-418c-a068-465ed3121a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:46 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Flow 'volume_create_manager' (0d285d7a-10e3-4cca-ad04-648730d0c60d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:46 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-0fbc54de-1871-47cf-9d7d-1712b14e2106 tempest-ProjectMemberTests-1297668706 None] Created volume successfully. Jul 08 01:26:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-de50deee-704d-4b43-9828-a0b01a210a34 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-de50deee-704d-4b43-9828-a0b01a210a34 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-de50deee-704d-4b43-9828-a0b01a210a34 tempest-ProjectMemberTests-1297668706 None] Creating offline snapshot 49b802cc-e79e-4179-8695-436f450de9a6 of volume 598db3c9-c85c-4326-9eef-c7cc60ffb2ba {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:26:47 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ce6a6a-a8f1-44e4-9d48-c309d5b3b5df]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-de50deee-704d-4b43-9828-a0b01a210a34 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:47 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba Jul 08 01:26:47 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:48 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-de50deee-704d-4b43-9828-a0b01a210a34 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba" returned: 0 in 0.808s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-de50deee-704d-4b43-9828-a0b01a210a34 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.49b802cc-e79e-4179-8695-436f450de9a6 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:48 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.49b802cc-e79e-4179-8695-436f450de9a6 1G Jul 08 01:26:48 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:49 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-de50deee-704d-4b43-9828-a0b01a210a34 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.49b802cc-e79e-4179-8695-436f450de9a6 1G" returned: 0 in 0.839s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:49 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-de50deee-704d-4b43-9828-a0b01a210a34 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.49b802cc-e79e-4179-8695-436f450de9a6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:49 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.49b802cc-e79e-4179-8695-436f450de9a6 Jul 08 01:26:49 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:50 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-de50deee-704d-4b43-9828-a0b01a210a34 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.49b802cc-e79e-4179-8695-436f450de9a6" returned: 0 in 0.750s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:50 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-de50deee-704d-4b43-9828-a0b01a210a34 tempest-ProjectMemberTests-1297668706 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.49b802cc-e79e-4179-8695-436f450de9a6 is being set with open permissions: ugo+rw Jul 08 01:26:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-de50deee-704d-4b43-9828-a0b01a210a34 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.49b802cc-e79e-4179-8695-436f450de9a6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:50 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.49b802cc-e79e-4179-8695-436f450de9a6 Jul 08 01:26:50 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:50 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-de50deee-704d-4b43-9828-a0b01a210a34 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.49b802cc-e79e-4179-8695-436f450de9a6" returned: 0 in 0.687s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-de50deee-704d-4b43-9828-a0b01a210a34 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:50 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.info Jul 08 01:26:50 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:51 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-de50deee-704d-4b43-9828-a0b01a210a34 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.info" returned: 0 in 0.665s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:51 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-de50deee-704d-4b43-9828-a0b01a210a34 tempest-ProjectMemberTests-1297668706 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.info is being set with open permissions: ugo+rw Jul 08 01:26:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-de50deee-704d-4b43-9828-a0b01a210a34 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:51 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.info Jul 08 01:26:51 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:52 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-de50deee-704d-4b43-9828-a0b01a210a34 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.info" returned: 0 in 0.680s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-de50deee-704d-4b43-9828-a0b01a210a34 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.537s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:52 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-de50deee-704d-4b43-9828-a0b01a210a34 tempest-ProjectMemberTests-1297668706 None] Create snapshot completed successfully Jul 08 01:26:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e7018caf-4c57-4f86-bb4c-d613c8f39961 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-49b802cc-e79e-4179-8695-436f450de9a6-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e7018caf-4c57-4f86-bb4c-d613c8f39961 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-49b802cc-e79e-4179-8695-436f450de9a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e7018caf-4c57-4f86-bb4c-d613c8f39961 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-598db3c9-c85c-4326-9eef-c7cc60ffb2ba" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e7018caf-4c57-4f86-bb4c-d613c8f39961 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-598db3c9-c85c-4326-9eef-c7cc60ffb2ba" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e7018caf-4c57-4f86-bb4c-d613c8f39961 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-49b802cc-e79e-4179-8695-436f450de9a6" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:52 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e7018caf-4c57-4f86-bb4c-d613c8f39961 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-49b802cc-e79e-4179-8695-436f450de9a6" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-e7018caf-4c57-4f86-bb4c-d613c8f39961 tempest-ProjectMemberTests-1297668706 None] Deleting offline snapshot 49b802cc-e79e-4179-8695-436f450de9a6 of volume 598db3c9-c85c-4326-9eef-c7cc60ffb2ba {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:26:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-e7018caf-4c57-4f86-bb4c-d613c8f39961 tempest-ProjectMemberTests-1297668706 None] snapshot_file for this snap is: volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.49b802cc-e79e-4179-8695-436f450de9a6 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:26:52 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c33ec1d-db95-4b87-8723-d8fad656f455]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e7018caf-4c57-4f86-bb4c-d613c8f39961 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.49b802cc-e79e-4179-8695-436f450de9a6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:52 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.49b802cc-e79e-4179-8695-436f450de9a6 Jul 08 01:26:52 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:53 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e7018caf-4c57-4f86-bb4c-d613c8f39961 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.49b802cc-e79e-4179-8695-436f450de9a6" returned: 0 in 0.769s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:53 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-e7018caf-4c57-4f86-bb4c-d613c8f39961 tempest-ProjectMemberTests-1297668706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:26:53 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[73256584-5705-47f5-94db-847cf1f513fb]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e7018caf-4c57-4f86-bb4c-d613c8f39961 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:53 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba Jul 08 01:26:53 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:54 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e7018caf-4c57-4f86-bb4c-d613c8f39961 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba" returned: 0 in 0.814s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e7018caf-4c57-4f86-bb4c-d613c8f39961 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.49b802cc-e79e-4179-8695-436f450de9a6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:54 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.49b802cc-e79e-4179-8695-436f450de9a6 Jul 08 01:26:54 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:55 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e7018caf-4c57-4f86-bb4c-d613c8f39961 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.49b802cc-e79e-4179-8695-436f450de9a6" returned: 0 in 0.755s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e7018caf-4c57-4f86-bb4c-d613c8f39961 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.49b802cc-e79e-4179-8695-436f450de9a6 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:55 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.49b802cc-e79e-4179-8695-436f450de9a6 Jul 08 01:26:55 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:55 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e7018caf-4c57-4f86-bb4c-d613c8f39961 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba.49b802cc-e79e-4179-8695-436f450de9a6" returned: 0 in 0.643s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e7018caf-4c57-4f86-bb4c-d613c8f39961 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-49b802cc-e79e-4179-8695-436f450de9a6" released by "_delete_snapshot" :: held 3.085s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e7018caf-4c57-4f86-bb4c-d613c8f39961 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-598db3c9-c85c-4326-9eef-c7cc60ffb2ba" released by "delete_snapshot" :: held 3.107s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:55 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-e7018caf-4c57-4f86-bb4c-d613c8f39961 tempest-ProjectMemberTests-1297668706 None] Created reservations ['cfb22f49-5e64-4e77-b58c-ba716910a918', '4302ab0a-aeaf-48c0-8004-4c39e3746b4b', 'f5853913-919f-413c-9ac5-09c121b93031', '82d0c1bd-3469-43a8-af1f-3bcfdc94e5b1'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:56 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-e7018caf-4c57-4f86-bb4c-d613c8f39961 tempest-ProjectMemberTests-1297668706 None] Delete snapshot completed successfully. Jul 08 01:26:56 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e7018caf-4c57-4f86-bb4c-d613c8f39961 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-49b802cc-e79e-4179-8695-436f450de9a6-delete_snapshot" released by "delete_snapshot" :: held 3.248s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-204ceab0-e877-4be0-ade9-254f9ccf5ed7 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-598db3c9-c85c-4326-9eef-c7cc60ffb2ba-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-204ceab0-e877-4be0-ade9-254f9ccf5ed7 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-598db3c9-c85c-4326-9eef-c7cc60ffb2ba-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-204ceab0-e877-4be0-ade9-254f9ccf5ed7 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-598db3c9-c85c-4326-9eef-c7cc60ffb2ba" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:26:57 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-204ceab0-e877-4be0-ade9-254f9ccf5ed7 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-598db3c9-c85c-4326-9eef-c7cc60ffb2ba" acquired by "delete_volume" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:26:57 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f91891-29a9-47bf-a985-d55fbdb0b9ba]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:26:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-204ceab0-e877-4be0-ade9-254f9ccf5ed7 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:57 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba Jul 08 01:26:57 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:57 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-204ceab0-e877-4be0-ade9-254f9ccf5ed7 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba" returned: 0 in 0.830s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-204ceab0-e877-4be0-ade9-254f9ccf5ed7 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:57 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba Jul 08 01:26:58 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:58 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-204ceab0-e877-4be0-ade9-254f9ccf5ed7 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-598db3c9-c85c-4326-9eef-c7cc60ffb2ba" returned: 0 in 0.761s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-204ceab0-e877-4be0-ade9-254f9ccf5ed7 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-598db3c9-c85c-4326-9eef-c7cc60ffb2ba" released by "delete_volume" :: held 1.661s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:58 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-204ceab0-e877-4be0-ade9-254f9ccf5ed7 tempest-ProjectMemberTests-1297668706 None] Created reservations ['04bb7adb-9c96-46f1-b2aa-5ce25b1a2128', '343ca737-0f3c-4672-8e2d-ffe24e7b5bc9', '507bfc19-1ba1-452c-8ffc-485f8c54b2fc', '490649db-da0e-412b-9637-a0ff1becedc4'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:26:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-204ceab0-e877-4be0-ade9-254f9ccf5ed7 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-204ceab0-e877-4be0-ade9-254f9ccf5ed7 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-204ceab0-e877-4be0-ade9-254f9ccf5ed7 tempest-ProjectMemberTests-1297668706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:58 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-204ceab0-e877-4be0-ade9-254f9ccf5ed7 tempest-ProjectMemberTests-1297668706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-204ceab0-e877-4be0-ade9-254f9ccf5ed7 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-204ceab0-e877-4be0-ade9-254f9ccf5ed7 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:58 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:26:58 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:26:59 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-204ceab0-e877-4be0-ade9-254f9ccf5ed7 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.762s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-204ceab0-e877-4be0-ade9-254f9ccf5ed7 tempest-ProjectMemberTests-1297668706 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:26:59 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-204ceab0-e877-4be0-ade9-254f9ccf5ed7 tempest-ProjectMemberTests-1297668706 None] Deleted volume successfully. Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-204ceab0-e877-4be0-ade9-254f9ccf5ed7 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-598db3c9-c85c-4326-9eef-c7cc60ffb2ba-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Flow 'volume_create_manager' (2fe6d139-6a1f-4ae3-a317-a2e76b9e0b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748e8c91-d4dc-4585-aff1-5498025183fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (748e8c91-d4dc-4585-aff1-5498025183fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2090529180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd8e7e68-ec3f-43d4-ad80-703cc1f4da41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb446c86b7743258e78554d23b104d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:00Z,use_quota=True,user_id='c22268e4ddd34d8eb4bf4ae8a14331a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fc1adfc-5b02-4b04-a25c-c0537550878c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fc1adfc-5b02-4b04-a25c-c0537550878c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f0132d-49df-45d6-9acf-3da173991067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f0132d-49df-45d6-9acf-3da173991067) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd8e7e68-ec3f-43d4-ad80-703cc1f4da41', 'volume_name': 'volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2b92fc-cc5e-449c-9582-2ceef2fb9908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d2b92fc-cc5e-449c-9582-2ceef2fb9908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (587df9b7-7e8b-4d24-9c7c-5834a3f3f43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:26:59 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Volume bd8e7e68-ec3f-43d4-ad80-703cc1f4da41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41', 'volume_size': 1} Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:26:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2090529180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd8e7e68-ec3f-43d4-ad80-703cc1f4da41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb446c86b7743258e78554d23b104d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:00Z,use_quota=True,user_id='c22268e4ddd34d8eb4bf4ae8a14331a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Creating volume bd8e7e68-ec3f-43d4-ad80-703cc1f4da41 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:26:59 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:26:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:26:59 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41 1073741824 Jul 08 01:26:59 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:00 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41 1073741824" returned: 0 in 0.958s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:00 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41 Jul 08 01:27:00 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:01 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41" returned: 0 in 0.654s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (587df9b7-7e8b-4d24-9c7c-5834a3f3f43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (011a3aed-9904-4b15-b990-d8d96fcc6eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:01 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Volume volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41 (bd8e7e68-ec3f-43d4-ad80-703cc1f4da41): created successfully Jul 08 01:27:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (011a3aed-9904-4b15-b990-d8d96fcc6eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:01 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Flow 'volume_create_manager' (2fe6d139-6a1f-4ae3-a317-a2e76b9e0b07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:01 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-9a2fa958-9150-4f8c-b35e-c268cfdc851c tempest-ProjectMemberTests-1297668706 None] Created volume successfully. Jul 08 01:27:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fde79c47-1514-4696-ae2f-1413aad11cde tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fde79c47-1514-4696-ae2f-1413aad11cde tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-fde79c47-1514-4696-ae2f-1413aad11cde tempest-ProjectMemberTests-1297668706 None] Creating offline snapshot 2546cc21-8650-4827-a807-b90e7842140a of volume bd8e7e68-ec3f-43d4-ad80-703cc1f4da41 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:27:02 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d036ffcc-ec3c-4316-b3fd-ba01290b76b9]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fde79c47-1514-4696-ae2f-1413aad11cde tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:02 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41 Jul 08 01:27:02 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:02 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fde79c47-1514-4696-ae2f-1413aad11cde tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41" returned: 0 in 0.796s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fde79c47-1514-4696-ae2f-1413aad11cde tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.2546cc21-8650-4827-a807-b90e7842140a 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:02 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.2546cc21-8650-4827-a807-b90e7842140a 1G Jul 08 01:27:02 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:03 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fde79c47-1514-4696-ae2f-1413aad11cde tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.2546cc21-8650-4827-a807-b90e7842140a 1G" returned: 0 in 0.853s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fde79c47-1514-4696-ae2f-1413aad11cde tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.2546cc21-8650-4827-a807-b90e7842140a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:03 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.2546cc21-8650-4827-a807-b90e7842140a Jul 08 01:27:03 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:04 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fde79c47-1514-4696-ae2f-1413aad11cde tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.2546cc21-8650-4827-a807-b90e7842140a" returned: 0 in 0.706s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:04 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-fde79c47-1514-4696-ae2f-1413aad11cde tempest-ProjectMemberTests-1297668706 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.2546cc21-8650-4827-a807-b90e7842140a is being set with open permissions: ugo+rw Jul 08 01:27:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fde79c47-1514-4696-ae2f-1413aad11cde tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.2546cc21-8650-4827-a807-b90e7842140a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:04 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.2546cc21-8650-4827-a807-b90e7842140a Jul 08 01:27:04 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:05 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fde79c47-1514-4696-ae2f-1413aad11cde tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.2546cc21-8650-4827-a807-b90e7842140a" returned: 0 in 0.643s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fde79c47-1514-4696-ae2f-1413aad11cde tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:05 devstack sudo[106854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.info Jul 08 01:27:05 devstack sudo[106854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:05 devstack sudo[106854]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fde79c47-1514-4696-ae2f-1413aad11cde tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.info" returned: 0 in 0.652s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:05 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-fde79c47-1514-4696-ae2f-1413aad11cde tempest-ProjectMemberTests-1297668706 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.info is being set with open permissions: ugo+rw Jul 08 01:27:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fde79c47-1514-4696-ae2f-1413aad11cde tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:05 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.info Jul 08 01:27:05 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:06 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fde79c47-1514-4696-ae2f-1413aad11cde tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.info" returned: 0 in 0.632s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fde79c47-1514-4696-ae2f-1413aad11cde tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.382s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:06 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-fde79c47-1514-4696-ae2f-1413aad11cde tempest-ProjectMemberTests-1297668706 None] Create snapshot completed successfully Jul 08 01:27:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e71ca791-3d9b-4efd-b1d0-304d96dc834f tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-2546cc21-8650-4827-a807-b90e7842140a-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e71ca791-3d9b-4efd-b1d0-304d96dc834f tempest-ProjectMemberTests-1297668706 None] Lock "cinder-2546cc21-8650-4827-a807-b90e7842140a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e71ca791-3d9b-4efd-b1d0-304d96dc834f tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e71ca791-3d9b-4efd-b1d0-304d96dc834f tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e71ca791-3d9b-4efd-b1d0-304d96dc834f tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-2546cc21-8650-4827-a807-b90e7842140a" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e71ca791-3d9b-4efd-b1d0-304d96dc834f tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-2546cc21-8650-4827-a807-b90e7842140a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-e71ca791-3d9b-4efd-b1d0-304d96dc834f tempest-ProjectMemberTests-1297668706 None] Deleting offline snapshot 2546cc21-8650-4827-a807-b90e7842140a of volume bd8e7e68-ec3f-43d4-ad80-703cc1f4da41 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:27:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-e71ca791-3d9b-4efd-b1d0-304d96dc834f tempest-ProjectMemberTests-1297668706 None] snapshot_file for this snap is: volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.2546cc21-8650-4827-a807-b90e7842140a {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:27:07 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e199a16-88d6-4213-91cf-5e9e0486a851]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e71ca791-3d9b-4efd-b1d0-304d96dc834f tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.2546cc21-8650-4827-a807-b90e7842140a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:07 devstack sudo[106860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.2546cc21-8650-4827-a807-b90e7842140a Jul 08 01:27:07 devstack sudo[106860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:08 devstack sudo[106860]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e71ca791-3d9b-4efd-b1d0-304d96dc834f tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.2546cc21-8650-4827-a807-b90e7842140a" returned: 0 in 0.754s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:08 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-e71ca791-3d9b-4efd-b1d0-304d96dc834f tempest-ProjectMemberTests-1297668706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:27:08 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5759b7-3dbd-4806-bb0f-1406e8bf0fd9]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e71ca791-3d9b-4efd-b1d0-304d96dc834f tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:08 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41 Jul 08 01:27:08 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:08 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e71ca791-3d9b-4efd-b1d0-304d96dc834f tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41" returned: 0 in 0.805s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e71ca791-3d9b-4efd-b1d0-304d96dc834f tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.2546cc21-8650-4827-a807-b90e7842140a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:08 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.2546cc21-8650-4827-a807-b90e7842140a Jul 08 01:27:08 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:09 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e71ca791-3d9b-4efd-b1d0-304d96dc834f tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.2546cc21-8650-4827-a807-b90e7842140a" returned: 0 in 0.744s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e71ca791-3d9b-4efd-b1d0-304d96dc834f tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.2546cc21-8650-4827-a807-b90e7842140a {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:09 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.2546cc21-8650-4827-a807-b90e7842140a Jul 08 01:27:09 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:10 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e71ca791-3d9b-4efd-b1d0-304d96dc834f tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41.2546cc21-8650-4827-a807-b90e7842140a" returned: 0 in 0.647s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e71ca791-3d9b-4efd-b1d0-304d96dc834f tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-2546cc21-8650-4827-a807-b90e7842140a" released by "_delete_snapshot" :: held 3.043s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e71ca791-3d9b-4efd-b1d0-304d96dc834f tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41" released by "delete_snapshot" :: held 3.071s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:10 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-e71ca791-3d9b-4efd-b1d0-304d96dc834f tempest-ProjectMemberTests-1297668706 None] Created reservations ['38e6b59c-7d10-4eba-a815-701bfa7dc2c3', '7f898dea-03e5-44a3-aad4-00b35122aaed', '9103d20e-b944-461a-94c8-e9543efa714b', '584a5a9c-1c4a-4b89-948e-47fdb5dc8e7a'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:10 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-e71ca791-3d9b-4efd-b1d0-304d96dc834f tempest-ProjectMemberTests-1297668706 None] Delete snapshot completed successfully. Jul 08 01:27:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e71ca791-3d9b-4efd-b1d0-304d96dc834f tempest-ProjectMemberTests-1297668706 None] Lock "cinder-2546cc21-8650-4827-a807-b90e7842140a-delete_snapshot" released by "delete_snapshot" :: held 3.444s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:11 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-307364c3-5311-42b0-958f-2aee51a22f50 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:11 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-307364c3-5311-42b0-958f-2aee51a22f50 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:11 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-307364c3-5311-42b0-958f-2aee51a22f50 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:11 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-307364c3-5311-42b0-958f-2aee51a22f50 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41" acquired by "delete_volume" :: waited 0.014s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:11 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[84de084d-ccb1-4943-940e-42dbc20a7d4d]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-307364c3-5311-42b0-958f-2aee51a22f50 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:11 devstack sudo[106879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41 Jul 08 01:27:11 devstack sudo[106879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:12 devstack sudo[106879]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-307364c3-5311-42b0-958f-2aee51a22f50 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41" returned: 0 in 0.758s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-307364c3-5311-42b0-958f-2aee51a22f50 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:12 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41 Jul 08 01:27:12 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:13 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-307364c3-5311-42b0-958f-2aee51a22f50 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41" returned: 0 in 0.655s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-307364c3-5311-42b0-958f-2aee51a22f50 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41" released by "delete_volume" :: held 1.472s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:13 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-307364c3-5311-42b0-958f-2aee51a22f50 tempest-ProjectMemberTests-1297668706 None] Created reservations ['6685d7fa-4878-4c9a-80d7-557225587ab9', 'f800850c-2269-45d8-90bc-48837b24f961', '14c9cd16-8e10-449c-94cc-385ec61da89a', 'd22eb023-ca26-4585-b9ec-0a45a1ebd61f'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-307364c3-5311-42b0-958f-2aee51a22f50 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-307364c3-5311-42b0-958f-2aee51a22f50 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-307364c3-5311-42b0-958f-2aee51a22f50 tempest-ProjectMemberTests-1297668706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:13 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-307364c3-5311-42b0-958f-2aee51a22f50 tempest-ProjectMemberTests-1297668706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-307364c3-5311-42b0-958f-2aee51a22f50 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-307364c3-5311-42b0-958f-2aee51a22f50 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:13 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:27:13 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:13 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-307364c3-5311-42b0-958f-2aee51a22f50 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.681s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:13 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-307364c3-5311-42b0-958f-2aee51a22f50 tempest-ProjectMemberTests-1297668706 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:13 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-307364c3-5311-42b0-958f-2aee51a22f50 tempest-ProjectMemberTests-1297668706 None] Deleted volume successfully. Jul 08 01:27:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-307364c3-5311-42b0-958f-2aee51a22f50 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-bd8e7e68-ec3f-43d4-ad80-703cc1f4da41-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:14 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:14 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Flow 'volume_create_manager' (5ae847e8-da10-46e4-8df3-d6764163de0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:14 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4755cb-ce73-4ca7-94e2-c24e0eae06e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:14 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d4755cb-ce73-4ca7-94e2-c24e0eae06e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-70823241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb446c86b7743258e78554d23b104d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:14Z,use_quota=True,user_id='c22268e4ddd34d8eb4bf4ae8a14331a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:14 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1020fe0-e898-46c8-968d-9dd7f47c88e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:14 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1020fe0-e898-46c8-968d-9dd7f47c88e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:14 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680bb140-87f3-424c-94de-eeb68abbdc04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:14 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (680bb140-87f3-424c-94de-eeb68abbdc04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7', 'volume_name': 'volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:14 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744ce4f9-c026-4c4c-b03a-ee691f79c69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:14 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (744ce4f9-c026-4c4c-b03a-ee691f79c69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:14 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (affd972d-54c1-4160-8622-b69d53d8afe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:14 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Volume 2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7', 'volume_size': 1} Jul 08 01:27:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:14 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-70823241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fb446c86b7743258e78554d23b104d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:14Z,use_quota=True,user_id='c22268e4ddd34d8eb4bf4ae8a14331a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:14 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Creating volume 2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:14 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:14 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:14 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:14 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:27:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:14 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7 1073741824 Jul 08 01:27:14 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:15 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7 1073741824" returned: 0 in 0.850s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:15 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7 Jul 08 01:27:15 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:15 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7" returned: 0 in 0.663s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] <== create_volume: return (1603ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.605s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (affd972d-54c1-4160-8622-b69d53d8afe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71edc86b-4196-4f5f-abcc-db2e4bca4b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:16 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Volume volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7 (2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7): created successfully Jul 08 01:27:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71edc86b-4196-4f5f-abcc-db2e4bca4b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:16 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Flow 'volume_create_manager' (5ae847e8-da10-46e4-8df3-d6764163de0d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:16 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-52a8d372-e76b-4f70-8aa8-da9389e5f4a8 tempest-ProjectMemberTests-1297668706 None] Created volume successfully. Jul 08 01:27:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fdc0d32f-69b5-4a82-8e8d-7efd950aeaa5 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fdc0d32f-69b5-4a82-8e8d-7efd950aeaa5 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:16 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-fdc0d32f-69b5-4a82-8e8d-7efd950aeaa5 tempest-ProjectMemberTests-1297668706 None] Creating offline snapshot d64146c2-4faa-4eb1-a7b7-74033d15cf76 of volume 2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:27:16 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[22eed3df-07cb-4ad9-93cc-92afb1a4c834]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fdc0d32f-69b5-4a82-8e8d-7efd950aeaa5 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:16 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7 Jul 08 01:27:16 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:17 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fdc0d32f-69b5-4a82-8e8d-7efd950aeaa5 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7" returned: 0 in 0.747s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fdc0d32f-69b5-4a82-8e8d-7efd950aeaa5 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.d64146c2-4faa-4eb1-a7b7-74033d15cf76 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:17 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.d64146c2-4faa-4eb1-a7b7-74033d15cf76 1G Jul 08 01:27:17 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:18 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fdc0d32f-69b5-4a82-8e8d-7efd950aeaa5 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.d64146c2-4faa-4eb1-a7b7-74033d15cf76 1G" returned: 0 in 0.845s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fdc0d32f-69b5-4a82-8e8d-7efd950aeaa5 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.d64146c2-4faa-4eb1-a7b7-74033d15cf76 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:18 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.d64146c2-4faa-4eb1-a7b7-74033d15cf76 Jul 08 01:27:18 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:18 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fdc0d32f-69b5-4a82-8e8d-7efd950aeaa5 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.d64146c2-4faa-4eb1-a7b7-74033d15cf76" returned: 0 in 0.716s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:18 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-fdc0d32f-69b5-4a82-8e8d-7efd950aeaa5 tempest-ProjectMemberTests-1297668706 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.d64146c2-4faa-4eb1-a7b7-74033d15cf76 is being set with open permissions: ugo+rw Jul 08 01:27:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fdc0d32f-69b5-4a82-8e8d-7efd950aeaa5 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.d64146c2-4faa-4eb1-a7b7-74033d15cf76 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:18 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.d64146c2-4faa-4eb1-a7b7-74033d15cf76 Jul 08 01:27:18 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:19 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fdc0d32f-69b5-4a82-8e8d-7efd950aeaa5 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.d64146c2-4faa-4eb1-a7b7-74033d15cf76" returned: 0 in 0.641s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fdc0d32f-69b5-4a82-8e8d-7efd950aeaa5 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:19 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.info Jul 08 01:27:19 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:20 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fdc0d32f-69b5-4a82-8e8d-7efd950aeaa5 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.info" returned: 0 in 0.706s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:20 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-fdc0d32f-69b5-4a82-8e8d-7efd950aeaa5 tempest-ProjectMemberTests-1297668706 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.info is being set with open permissions: ugo+rw Jul 08 01:27:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fdc0d32f-69b5-4a82-8e8d-7efd950aeaa5 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:20 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.info Jul 08 01:27:20 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:20 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-fdc0d32f-69b5-4a82-8e8d-7efd950aeaa5 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.info" returned: 0 in 0.678s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-fdc0d32f-69b5-4a82-8e8d-7efd950aeaa5 tempest-ProjectMemberTests-1297668706 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.416s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:20 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-fdc0d32f-69b5-4a82-8e8d-7efd950aeaa5 tempest-ProjectMemberTests-1297668706 None] Create snapshot completed successfully Jul 08 01:27:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-23041491-d6ec-4ac9-879d-9418b9720ac3 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-d64146c2-4faa-4eb1-a7b7-74033d15cf76-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-23041491-d6ec-4ac9-879d-9418b9720ac3 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-d64146c2-4faa-4eb1-a7b7-74033d15cf76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-23041491-d6ec-4ac9-879d-9418b9720ac3 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-23041491-d6ec-4ac9-879d-9418b9720ac3 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-23041491-d6ec-4ac9-879d-9418b9720ac3 tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-d64146c2-4faa-4eb1-a7b7-74033d15cf76" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:21 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-23041491-d6ec-4ac9-879d-9418b9720ac3 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-d64146c2-4faa-4eb1-a7b7-74033d15cf76" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-23041491-d6ec-4ac9-879d-9418b9720ac3 tempest-ProjectMemberTests-1297668706 None] Deleting offline snapshot d64146c2-4faa-4eb1-a7b7-74033d15cf76 of volume 2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:27:21 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-23041491-d6ec-4ac9-879d-9418b9720ac3 tempest-ProjectMemberTests-1297668706 None] snapshot_file for this snap is: volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.d64146c2-4faa-4eb1-a7b7-74033d15cf76 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:27:21 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[38924222-97aa-4e69-9716-2e2b7d5c35dc]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-23041491-d6ec-4ac9-879d-9418b9720ac3 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.d64146c2-4faa-4eb1-a7b7-74033d15cf76 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:22 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.d64146c2-4faa-4eb1-a7b7-74033d15cf76 Jul 08 01:27:22 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:22 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-23041491-d6ec-4ac9-879d-9418b9720ac3 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.d64146c2-4faa-4eb1-a7b7-74033d15cf76" returned: 0 in 0.978s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:22 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-23041491-d6ec-4ac9-879d-9418b9720ac3 tempest-ProjectMemberTests-1297668706 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:27:22 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12a90a5-2922-4e2d-af05-19e2ce5a0977]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-23041491-d6ec-4ac9-879d-9418b9720ac3 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:23 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7 Jul 08 01:27:23 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:23 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-23041491-d6ec-4ac9-879d-9418b9720ac3 tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7" returned: 0 in 0.869s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-23041491-d6ec-4ac9-879d-9418b9720ac3 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.d64146c2-4faa-4eb1-a7b7-74033d15cf76 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:23 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.d64146c2-4faa-4eb1-a7b7-74033d15cf76 Jul 08 01:27:23 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:24 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-23041491-d6ec-4ac9-879d-9418b9720ac3 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.d64146c2-4faa-4eb1-a7b7-74033d15cf76" returned: 0 in 0.789s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-23041491-d6ec-4ac9-879d-9418b9720ac3 tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.d64146c2-4faa-4eb1-a7b7-74033d15cf76 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:24 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.d64146c2-4faa-4eb1-a7b7-74033d15cf76 Jul 08 01:27:24 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:25 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-23041491-d6ec-4ac9-879d-9418b9720ac3 tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7.d64146c2-4faa-4eb1-a7b7-74033d15cf76" returned: 0 in 0.720s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-23041491-d6ec-4ac9-879d-9418b9720ac3 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-d64146c2-4faa-4eb1-a7b7-74033d15cf76" released by "_delete_snapshot" :: held 3.453s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-23041491-d6ec-4ac9-879d-9418b9720ac3 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7" released by "delete_snapshot" :: held 3.475s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:25 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-23041491-d6ec-4ac9-879d-9418b9720ac3 tempest-ProjectMemberTests-1297668706 None] Created reservations ['bfc6130c-086a-4e9d-809b-d5bccff60fad', '44417f7c-4883-4650-b161-edd76034c18f', 'd8597c3c-ca02-4b08-a21b-b6ca94fcb5e9', 'a3d1d856-a638-477c-a91d-20cc03dcfd38'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:25 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-23041491-d6ec-4ac9-879d-9418b9720ac3 tempest-ProjectMemberTests-1297668706 None] Delete snapshot completed successfully. Jul 08 01:27:25 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-23041491-d6ec-4ac9-879d-9418b9720ac3 tempest-ProjectMemberTests-1297668706 None] Lock "cinder-d64146c2-4faa-4eb1-a7b7-74033d15cf76-delete_snapshot" released by "delete_snapshot" :: held 3.616s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-17488acb-08e5-4089-a4ce-9864e48e83ca tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-17488acb-08e5-4089-a4ce-9864e48e83ca tempest-ProjectMemberTests-1297668706 None] Lock "cinder-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-17488acb-08e5-4089-a4ce-9864e48e83ca tempest-ProjectMemberTests-1297668706 None] Acquiring lock "cinder-quobyte-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:26 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-17488acb-08e5-4089-a4ce-9864e48e83ca tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7" acquired by "delete_volume" :: waited 0.016s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:26 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[f128cadd-4968-49b7-9eea-b5b40b829f32]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-17488acb-08e5-4089-a4ce-9864e48e83ca tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:26 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7 Jul 08 01:27:26 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:27 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-17488acb-08e5-4089-a4ce-9864e48e83ca tempest-ProjectMemberTests-1297668706 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7" returned: 0 in 0.807s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-17488acb-08e5-4089-a4ce-9864e48e83ca tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:27 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7 Jul 08 01:27:27 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:27 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-17488acb-08e5-4089-a4ce-9864e48e83ca tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7" returned: 0 in 0.683s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:27 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-17488acb-08e5-4089-a4ce-9864e48e83ca tempest-ProjectMemberTests-1297668706 None] Lock "cinder-quobyte-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7" released by "delete_volume" :: held 1.553s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:27 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-17488acb-08e5-4089-a4ce-9864e48e83ca tempest-ProjectMemberTests-1297668706 None] Created reservations ['08840bdf-a55a-47dc-abe1-a8eaa30a28aa', '57d8b19c-35d2-4416-a369-16579612ee69', 'b79a2103-be05-43f0-b94d-ccafcbe26bab', '0ded82d0-149d-4f5c-a8ef-de5c7111d0e6'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-17488acb-08e5-4089-a4ce-9864e48e83ca tempest-ProjectMemberTests-1297668706 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-17488acb-08e5-4089-a4ce-9864e48e83ca tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-17488acb-08e5-4089-a4ce-9864e48e83ca tempest-ProjectMemberTests-1297668706 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:27 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-17488acb-08e5-4089-a4ce-9864e48e83ca tempest-ProjectMemberTests-1297668706 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-17488acb-08e5-4089-a4ce-9864e48e83ca tempest-ProjectMemberTests-1297668706 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-17488acb-08e5-4089-a4ce-9864e48e83ca tempest-ProjectMemberTests-1297668706 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:27 devstack sudo[106993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:27:27 devstack sudo[106993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:28 devstack sudo[106993]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-17488acb-08e5-4089-a4ce-9864e48e83ca tempest-ProjectMemberTests-1297668706 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.662s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:28 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-17488acb-08e5-4089-a4ce-9864e48e83ca tempest-ProjectMemberTests-1297668706 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:28 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-17488acb-08e5-4089-a4ce-9864e48e83ca tempest-ProjectMemberTests-1297668706 None] Deleted volume successfully. Jul 08 01:27:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-17488acb-08e5-4089-a4ce-9864e48e83ca tempest-ProjectMemberTests-1297668706 None] Lock "cinder-2cd7cd88-e0e6-4b67-a6ad-b5b3b3f864f7-delete_volume" released by "delete_volume" :: held 2.425s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:32 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Flow 'volume_create_manager' (4c2412d1-7e77-42f4-8c9b-dcab8b009289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c302bb14-4623-41ff-aa80-62c93e3f381c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c302bb14-4623-41ff-aa80-62c93e3f381c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-822620524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f2d259-3d73-46fa-92b1-b9b6fafd4d6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ad44f7bcd24ea5addbd641ca3d95ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:32Z,use_quota=True,user_id='19902f8936ff47b98a6bc98e3315b91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55eb1d5d-d2b2-4fc8-a723-f8f39534b1ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55eb1d5d-d2b2-4fc8-a723-f8f39534b1ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f3f1936-2bdf-404a-8ba7-8cb9a6c48f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f3f1936-2bdf-404a-8ba7-8cb9a6c48f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76f2d259-3d73-46fa-92b1-b9b6fafd4d6b', 'volume_name': 'volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feea2f57-de16-4e92-b26e-2dd8c92224e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (feea2f57-de16-4e92-b26e-2dd8c92224e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:32 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6d8946-26e0-4b87-8921-3d7be9013485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:32 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Volume 76f2d259-3d73-46fa-92b1-b9b6fafd4d6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b', 'volume_size': 1} Jul 08 01:27:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-822620524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76f2d259-3d73-46fa-92b1-b9b6fafd4d6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ad44f7bcd24ea5addbd641ca3d95ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:32Z,use_quota=True,user_id='19902f8936ff47b98a6bc98e3315b91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Creating volume 76f2d259-3d73-46fa-92b1-b9b6fafd4d6b {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:32 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:32 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:27:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:32 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b 1073741824 Jul 08 01:27:32 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:33 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b 1073741824" returned: 0 in 0.932s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:33 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b Jul 08 01:27:33 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:34 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b" returned: 0 in 0.695s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] <== create_volume: return (1672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c6d8946-26e0-4b87-8921-3d7be9013485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900da3a5-d5a4-4892-8e18-12cd48528a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:34 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Volume volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b (76f2d259-3d73-46fa-92b1-b9b6fafd4d6b): created successfully Jul 08 01:27:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (900da3a5-d5a4-4892-8e18-12cd48528a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:34 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Flow 'volume_create_manager' (4c2412d1-7e77-42f4-8c9b-dcab8b009289) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:34 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f46283a7-4929-41b5-b0dd-9e7fe00d7864 tempest-ProjectReaderTests-1068820401 None] Created volume successfully. Jul 08 01:27:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d9a8b3d1-bdc2-4283-a0d6-a7b9740c8b78 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d9a8b3d1-bdc2-4283-a0d6-a7b9740c8b78 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:34 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-d9a8b3d1-bdc2-4283-a0d6-a7b9740c8b78 tempest-ProjectReaderTests-1068820401 None] Creating offline snapshot 4e535c08-3996-4133-a00d-6e035a50dfd0 of volume 76f2d259-3d73-46fa-92b1-b9b6fafd4d6b {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:27:34 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4eb2ab7-ad1d-4809-a6bc-d4b73ebd8b7f]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d9a8b3d1-bdc2-4283-a0d6-a7b9740c8b78 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:34 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b Jul 08 01:27:34 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:35 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d9a8b3d1-bdc2-4283-a0d6-a7b9740c8b78 tempest-ProjectReaderTests-1068820401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b" returned: 0 in 0.853s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d9a8b3d1-bdc2-4283-a0d6-a7b9740c8b78 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.4e535c08-3996-4133-a00d-6e035a50dfd0 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:35 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.4e535c08-3996-4133-a00d-6e035a50dfd0 1G Jul 08 01:27:35 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:36 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d9a8b3d1-bdc2-4283-a0d6-a7b9740c8b78 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.4e535c08-3996-4133-a00d-6e035a50dfd0 1G" returned: 0 in 0.855s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d9a8b3d1-bdc2-4283-a0d6-a7b9740c8b78 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.4e535c08-3996-4133-a00d-6e035a50dfd0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:36 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.4e535c08-3996-4133-a00d-6e035a50dfd0 Jul 08 01:27:36 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:37 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d9a8b3d1-bdc2-4283-a0d6-a7b9740c8b78 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.4e535c08-3996-4133-a00d-6e035a50dfd0" returned: 0 in 0.698s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:37 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-d9a8b3d1-bdc2-4283-a0d6-a7b9740c8b78 tempest-ProjectReaderTests-1068820401 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.4e535c08-3996-4133-a00d-6e035a50dfd0 is being set with open permissions: ugo+rw Jul 08 01:27:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d9a8b3d1-bdc2-4283-a0d6-a7b9740c8b78 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.4e535c08-3996-4133-a00d-6e035a50dfd0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:37 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.4e535c08-3996-4133-a00d-6e035a50dfd0 Jul 08 01:27:37 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:37 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d9a8b3d1-bdc2-4283-a0d6-a7b9740c8b78 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.4e535c08-3996-4133-a00d-6e035a50dfd0" returned: 0 in 0.671s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d9a8b3d1-bdc2-4283-a0d6-a7b9740c8b78 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:37 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.info Jul 08 01:27:37 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:38 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d9a8b3d1-bdc2-4283-a0d6-a7b9740c8b78 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.info" returned: 0 in 0.668s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:38 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-d9a8b3d1-bdc2-4283-a0d6-a7b9740c8b78 tempest-ProjectReaderTests-1068820401 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.info is being set with open permissions: ugo+rw Jul 08 01:27:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d9a8b3d1-bdc2-4283-a0d6-a7b9740c8b78 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:38 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.info Jul 08 01:27:38 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:39 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d9a8b3d1-bdc2-4283-a0d6-a7b9740c8b78 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.info" returned: 0 in 0.636s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:39 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d9a8b3d1-bdc2-4283-a0d6-a7b9740c8b78 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.461s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:39 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-d9a8b3d1-bdc2-4283-a0d6-a7b9740c8b78 tempest-ProjectReaderTests-1068820401 None] Create snapshot completed successfully Jul 08 01:27:39 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5076851d-5863-4b30-9fa0-f1985d0f56bc tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-4e535c08-3996-4133-a00d-6e035a50dfd0-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5076851d-5863-4b30-9fa0-f1985d0f56bc tempest-ProjectReaderTests-1068820401 None] Lock "cinder-4e535c08-3996-4133-a00d-6e035a50dfd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5076851d-5863-4b30-9fa0-f1985d0f56bc tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-quobyte-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5076851d-5863-4b30-9fa0-f1985d0f56bc tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5076851d-5863-4b30-9fa0-f1985d0f56bc tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-quobyte-4e535c08-3996-4133-a00d-6e035a50dfd0" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5076851d-5863-4b30-9fa0-f1985d0f56bc tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-4e535c08-3996-4133-a00d-6e035a50dfd0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-5076851d-5863-4b30-9fa0-f1985d0f56bc tempest-ProjectReaderTests-1068820401 None] Deleting offline snapshot 4e535c08-3996-4133-a00d-6e035a50dfd0 of volume 76f2d259-3d73-46fa-92b1-b9b6fafd4d6b {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:27:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-5076851d-5863-4b30-9fa0-f1985d0f56bc tempest-ProjectReaderTests-1068820401 None] snapshot_file for this snap is: volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.4e535c08-3996-4133-a00d-6e035a50dfd0 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:27:40 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3172b7a-fe0b-4dbe-878b-5b19e4a305e8]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5076851d-5863-4b30-9fa0-f1985d0f56bc tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.4e535c08-3996-4133-a00d-6e035a50dfd0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:40 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.4e535c08-3996-4133-a00d-6e035a50dfd0 Jul 08 01:27:40 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:40 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5076851d-5863-4b30-9fa0-f1985d0f56bc tempest-ProjectReaderTests-1068820401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.4e535c08-3996-4133-a00d-6e035a50dfd0" returned: 0 in 0.775s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-5076851d-5863-4b30-9fa0-f1985d0f56bc tempest-ProjectReaderTests-1068820401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:27:40 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[369808a1-72b4-4d0f-bd38-7336bd8bafdc]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5076851d-5863-4b30-9fa0-f1985d0f56bc tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:41 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b Jul 08 01:27:41 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:41 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5076851d-5863-4b30-9fa0-f1985d0f56bc tempest-ProjectReaderTests-1068820401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b" returned: 0 in 0.795s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5076851d-5863-4b30-9fa0-f1985d0f56bc tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.4e535c08-3996-4133-a00d-6e035a50dfd0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:41 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.4e535c08-3996-4133-a00d-6e035a50dfd0 Jul 08 01:27:41 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:42 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5076851d-5863-4b30-9fa0-f1985d0f56bc tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.4e535c08-3996-4133-a00d-6e035a50dfd0" returned: 0 in 0.759s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5076851d-5863-4b30-9fa0-f1985d0f56bc tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.4e535c08-3996-4133-a00d-6e035a50dfd0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:42 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.4e535c08-3996-4133-a00d-6e035a50dfd0 Jul 08 01:27:42 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:43 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5076851d-5863-4b30-9fa0-f1985d0f56bc tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b.4e535c08-3996-4133-a00d-6e035a50dfd0" returned: 0 in 0.673s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5076851d-5863-4b30-9fa0-f1985d0f56bc tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-4e535c08-3996-4133-a00d-6e035a50dfd0" released by "_delete_snapshot" :: held 3.102s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5076851d-5863-4b30-9fa0-f1985d0f56bc tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b" released by "delete_snapshot" :: held 3.123s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:43 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:INSERT=21,cinder:UPDATE=70,cinder:SELECT=56,cinder:DELETE=4 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:27:43 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=57,cinder:INSERT=19,cinder:UPDATE=75,cinder:DELETE=8 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:27:43 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-5076851d-5863-4b30-9fa0-f1985d0f56bc tempest-ProjectReaderTests-1068820401 None] Created reservations ['1e748205-0375-4d11-bb45-3bb1471a7cad', 'b4b1ca9c-96fa-4458-9df3-29af732b6ab0', 'a91a5302-fa96-41b1-86e8-b1728bf59315', '510535dc-4b06-4057-a30f-9a4eb7e5af68'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:43 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-5076851d-5863-4b30-9fa0-f1985d0f56bc tempest-ProjectReaderTests-1068820401 None] Delete snapshot completed successfully. Jul 08 01:27:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-5076851d-5863-4b30-9fa0-f1985d0f56bc tempest-ProjectReaderTests-1068820401 None] Lock "cinder-4e535c08-3996-4133-a00d-6e035a50dfd0-delete_snapshot" released by "delete_snapshot" :: held 3.302s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:44 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-390ea674-b7d9-4834-9625-d100bfe2fb3d tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:44 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-390ea674-b7d9-4834-9625-d100bfe2fb3d tempest-ProjectReaderTests-1068820401 None] Lock "cinder-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:44 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-390ea674-b7d9-4834-9625-d100bfe2fb3d tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-quobyte-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:44 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-390ea674-b7d9-4834-9625-d100bfe2fb3d tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b" acquired by "delete_volume" :: waited 0.016s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:44 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[81ce8417-7404-4ebd-bb73-58e8c7959274]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-390ea674-b7d9-4834-9625-d100bfe2fb3d tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:44 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b Jul 08 01:27:44 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:27:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:44 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:27:44 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:45 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-390ea674-b7d9-4834-9625-d100bfe2fb3d tempest-ProjectReaderTests-1068820401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b" returned: 0 in 0.836s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-390ea674-b7d9-4834-9625-d100bfe2fb3d tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:45 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b Jul 08 01:27:45 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:45 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.795s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:45 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:45 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:27:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 28 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:27:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:27:45 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-390ea674-b7d9-4834-9625-d100bfe2fb3d tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b" returned: 0 in 0.764s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:45 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-390ea674-b7d9-4834-9625-d100bfe2fb3d tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b" released by "delete_volume" :: held 1.670s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:46 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-390ea674-b7d9-4834-9625-d100bfe2fb3d tempest-ProjectReaderTests-1068820401 None] Created reservations ['175af2fb-e13a-4499-b993-04f7ed6426e3', 'e2e73c49-2e6f-421f-961d-ef7b4fce28c9', 'b577d1a5-40f9-48a7-84c4-c07ef5185fc2', '7489cf4f-77ce-41f0-93e9-b2083fc87d99'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-390ea674-b7d9-4834-9625-d100bfe2fb3d tempest-ProjectReaderTests-1068820401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-390ea674-b7d9-4834-9625-d100bfe2fb3d tempest-ProjectReaderTests-1068820401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-390ea674-b7d9-4834-9625-d100bfe2fb3d tempest-ProjectReaderTests-1068820401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-390ea674-b7d9-4834-9625-d100bfe2fb3d tempest-ProjectReaderTests-1068820401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-390ea674-b7d9-4834-9625-d100bfe2fb3d tempest-ProjectReaderTests-1068820401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-390ea674-b7d9-4834-9625-d100bfe2fb3d tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:46 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:27:46 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:46 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-390ea674-b7d9-4834-9625-d100bfe2fb3d tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.722s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:46 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-390ea674-b7d9-4834-9625-d100bfe2fb3d tempest-ProjectReaderTests-1068820401 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:27:46 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-390ea674-b7d9-4834-9625-d100bfe2fb3d tempest-ProjectReaderTests-1068820401 None] Deleted volume successfully. Jul 08 01:27:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-390ea674-b7d9-4834-9625-d100bfe2fb3d tempest-ProjectReaderTests-1068820401 None] Lock "cinder-76f2d259-3d73-46fa-92b1-b9b6fafd4d6b-delete_volume" released by "delete_volume" :: held 2.610s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:47 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:27:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Flow 'volume_create_manager' (6abfe1a0-3ad4-45e0-952f-81f1964c1751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da45928f-5deb-4b3a-ba1a-6bfc95289680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da45928f-5deb-4b3a-ba1a-6bfc95289680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1232889040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c4341ee-66fb-4a94-b965-65f7bdc5f255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ad44f7bcd24ea5addbd641ca3d95ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:47Z,use_quota=True,user_id='19902f8936ff47b98a6bc98e3315b91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01a283e-6649-41d2-9222-b21fa1e1345b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01a283e-6649-41d2-9222-b21fa1e1345b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d329d7-f079-45b6-b760-d61afce0b74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d329d7-f079-45b6-b760-d61afce0b74e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c4341ee-66fb-4a94-b965-65f7bdc5f255', 'volume_name': 'volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27b9373-71a8-48d1-a5bd-a47131fcbc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b27b9373-71a8-48d1-a5bd-a47131fcbc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:47 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b398fc-97b3-4308-94c2-b8dcd074f1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:47 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Volume 0c4341ee-66fb-4a94-b965-65f7bdc5f255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255', 'volume_size': 1} Jul 08 01:27:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:27:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1232889040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c4341ee-66fb-4a94-b965-65f7bdc5f255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ad44f7bcd24ea5addbd641ca3d95ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:27:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:27:47Z,use_quota=True,user_id='19902f8936ff47b98a6bc98e3315b91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:27:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Creating volume 0c4341ee-66fb-4a94-b965-65f7bdc5f255 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:27:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:27:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:27:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:47 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:27:47 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:27:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:47 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255 1073741824 Jul 08 01:27:47 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:48 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255 1073741824" returned: 0 in 1.042s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:48 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255 Jul 08 01:27:48 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:48 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255" returned: 0 in 0.779s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:48 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:27:48 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.870s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:49 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b398fc-97b3-4308-94c2-b8dcd074f1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:49 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fe8d7c-0b9b-4be8-8734-b5f0a752dd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:27:49 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Volume volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255 (0c4341ee-66fb-4a94-b965-65f7bdc5f255): created successfully Jul 08 01:27:49 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fe8d7c-0b9b-4be8-8734-b5f0a752dd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:27:49 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Flow 'volume_create_manager' (6abfe1a0-3ad4-45e0-952f-81f1964c1751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:27:49 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-c7b29980-a62a-4779-bac6-f0e703e4cdb4 tempest-ProjectReaderTests-1068820401 None] Created volume successfully. Jul 08 01:27:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-186557a6-070a-47d1-b9d8-30f25a3d8414 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:27:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-186557a6-070a-47d1-b9d8-30f25a3d8414 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:27:50 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-186557a6-070a-47d1-b9d8-30f25a3d8414 tempest-ProjectReaderTests-1068820401 None] Creating offline snapshot e0f15b2b-4b8c-4293-acce-ee42b27fc498 of volume 0c4341ee-66fb-4a94-b965-65f7bdc5f255 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:27:50 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[93e682a3-ccab-4f92-bb6e-c07fbd677c66]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:50 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-186557a6-070a-47d1-b9d8-30f25a3d8414 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:50 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255 Jul 08 01:27:50 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:51 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-186557a6-070a-47d1-b9d8-30f25a3d8414 tempest-ProjectReaderTests-1068820401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255" returned: 0 in 0.780s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-186557a6-070a-47d1-b9d8-30f25a3d8414 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.e0f15b2b-4b8c-4293-acce-ee42b27fc498 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:51 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.e0f15b2b-4b8c-4293-acce-ee42b27fc498 1G Jul 08 01:27:51 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:51 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-186557a6-070a-47d1-b9d8-30f25a3d8414 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.e0f15b2b-4b8c-4293-acce-ee42b27fc498 1G" returned: 0 in 0.838s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-186557a6-070a-47d1-b9d8-30f25a3d8414 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.e0f15b2b-4b8c-4293-acce-ee42b27fc498 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:52 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.e0f15b2b-4b8c-4293-acce-ee42b27fc498 Jul 08 01:27:52 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:52 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-186557a6-070a-47d1-b9d8-30f25a3d8414 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.e0f15b2b-4b8c-4293-acce-ee42b27fc498" returned: 0 in 0.737s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:52 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-186557a6-070a-47d1-b9d8-30f25a3d8414 tempest-ProjectReaderTests-1068820401 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.e0f15b2b-4b8c-4293-acce-ee42b27fc498 is being set with open permissions: ugo+rw Jul 08 01:27:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-186557a6-070a-47d1-b9d8-30f25a3d8414 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.e0f15b2b-4b8c-4293-acce-ee42b27fc498 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:52 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.e0f15b2b-4b8c-4293-acce-ee42b27fc498 Jul 08 01:27:52 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:53 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-186557a6-070a-47d1-b9d8-30f25a3d8414 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.e0f15b2b-4b8c-4293-acce-ee42b27fc498" returned: 0 in 0.686s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-186557a6-070a-47d1-b9d8-30f25a3d8414 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:53 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.info Jul 08 01:27:53 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:54 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-186557a6-070a-47d1-b9d8-30f25a3d8414 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.info" returned: 0 in 0.678s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:54 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-186557a6-070a-47d1-b9d8-30f25a3d8414 tempest-ProjectReaderTests-1068820401 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.info is being set with open permissions: ugo+rw Jul 08 01:27:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-186557a6-070a-47d1-b9d8-30f25a3d8414 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:54 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.info Jul 08 01:27:54 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:54 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-186557a6-070a-47d1-b9d8-30f25a3d8414 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.info" returned: 0 in 0.767s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-186557a6-070a-47d1-b9d8-30f25a3d8414 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.583s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:27:54 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-186557a6-070a-47d1-b9d8-30f25a3d8414 tempest-ProjectReaderTests-1068820401 None] Create snapshot completed successfully Jul 08 01:27:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66bba8ae-d6b6-44c9-9d9c-de8506fe6ced tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-e0f15b2b-4b8c-4293-acce-ee42b27fc498-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66bba8ae-d6b6-44c9-9d9c-de8506fe6ced tempest-ProjectReaderTests-1068820401 None] Lock "cinder-e0f15b2b-4b8c-4293-acce-ee42b27fc498-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66bba8ae-d6b6-44c9-9d9c-de8506fe6ced tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-quobyte-0c4341ee-66fb-4a94-b965-65f7bdc5f255" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66bba8ae-d6b6-44c9-9d9c-de8506fe6ced tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-0c4341ee-66fb-4a94-b965-65f7bdc5f255" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66bba8ae-d6b6-44c9-9d9c-de8506fe6ced tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-quobyte-e0f15b2b-4b8c-4293-acce-ee42b27fc498" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66bba8ae-d6b6-44c9-9d9c-de8506fe6ced tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-e0f15b2b-4b8c-4293-acce-ee42b27fc498" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-66bba8ae-d6b6-44c9-9d9c-de8506fe6ced tempest-ProjectReaderTests-1068820401 None] Deleting offline snapshot e0f15b2b-4b8c-4293-acce-ee42b27fc498 of volume 0c4341ee-66fb-4a94-b965-65f7bdc5f255 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:27:55 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-66bba8ae-d6b6-44c9-9d9c-de8506fe6ced tempest-ProjectReaderTests-1068820401 None] snapshot_file for this snap is: volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.e0f15b2b-4b8c-4293-acce-ee42b27fc498 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:27:55 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4c7174-00cf-479b-9239-23dcad7bda02]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66bba8ae-d6b6-44c9-9d9c-de8506fe6ced tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.e0f15b2b-4b8c-4293-acce-ee42b27fc498 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:55 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.e0f15b2b-4b8c-4293-acce-ee42b27fc498 Jul 08 01:27:55 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:56 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66bba8ae-d6b6-44c9-9d9c-de8506fe6ced tempest-ProjectReaderTests-1068820401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.e0f15b2b-4b8c-4293-acce-ee42b27fc498" returned: 0 in 0.836s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-66bba8ae-d6b6-44c9-9d9c-de8506fe6ced tempest-ProjectReaderTests-1068820401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:27:56 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3632e9e-0b10-4c17-a5d1-4c56c35987c4]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66bba8ae-d6b6-44c9-9d9c-de8506fe6ced tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:56 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255 Jul 08 01:27:56 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:57 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66bba8ae-d6b6-44c9-9d9c-de8506fe6ced tempest-ProjectReaderTests-1068820401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255" returned: 0 in 0.824s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66bba8ae-d6b6-44c9-9d9c-de8506fe6ced tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.e0f15b2b-4b8c-4293-acce-ee42b27fc498 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:57 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.e0f15b2b-4b8c-4293-acce-ee42b27fc498 Jul 08 01:27:57 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:58 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66bba8ae-d6b6-44c9-9d9c-de8506fe6ced tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.e0f15b2b-4b8c-4293-acce-ee42b27fc498" returned: 0 in 0.844s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66bba8ae-d6b6-44c9-9d9c-de8506fe6ced tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.e0f15b2b-4b8c-4293-acce-ee42b27fc498 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:27:58 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.e0f15b2b-4b8c-4293-acce-ee42b27fc498 Jul 08 01:27:58 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:27:58 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Jul 08 01:27:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-66bba8ae-d6b6-44c9-9d9c-de8506fe6ced tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255.e0f15b2b-4b8c-4293-acce-ee42b27fc498" returned: 0 in 0.711s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:27:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66bba8ae-d6b6-44c9-9d9c-de8506fe6ced tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-e0f15b2b-4b8c-4293-acce-ee42b27fc498" released by "_delete_snapshot" :: held 3.306s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66bba8ae-d6b6-44c9-9d9c-de8506fe6ced tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-0c4341ee-66fb-4a94-b965-65f7bdc5f255" released by "delete_snapshot" :: held 3.332s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:58 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-66bba8ae-d6b6-44c9-9d9c-de8506fe6ced tempest-ProjectReaderTests-1068820401 None] Created reservations ['9edcabdf-6f8c-4a23-8f0a-46489fc2e072', 'b7979e53-a2dd-4fe5-8084-32adbeb13bd7', '12c48240-ddf3-4ba5-901c-3bd9d7da8b22', '0388d58e-af8d-41d6-b6c1-e8710d092e3b'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:27:59 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-66bba8ae-d6b6-44c9-9d9c-de8506fe6ced tempest-ProjectReaderTests-1068820401 None] Delete snapshot completed successfully. Jul 08 01:27:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-66bba8ae-d6b6-44c9-9d9c-de8506fe6ced tempest-ProjectReaderTests-1068820401 None] Lock "cinder-e0f15b2b-4b8c-4293-acce-ee42b27fc498-delete_snapshot" released by "delete_snapshot" :: held 3.474s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:27:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eb43f3db-b5bc-4233-ada1-77942fddc9b1 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-0c4341ee-66fb-4a94-b965-65f7bdc5f255-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eb43f3db-b5bc-4233-ada1-77942fddc9b1 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-0c4341ee-66fb-4a94-b965-65f7bdc5f255-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eb43f3db-b5bc-4233-ada1-77942fddc9b1 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-quobyte-0c4341ee-66fb-4a94-b965-65f7bdc5f255" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:27:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eb43f3db-b5bc-4233-ada1-77942fddc9b1 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-0c4341ee-66fb-4a94-b965-65f7bdc5f255" acquired by "delete_volume" :: waited 0.014s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:27:59 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[04647c6a-ac05-4060-ac94-0e49cf2075bf]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:27:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eb43f3db-b5bc-4233-ada1-77942fddc9b1 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:00 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255 Jul 08 01:28:00 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:00 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eb43f3db-b5bc-4233-ada1-77942fddc9b1 tempest-ProjectReaderTests-1068820401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255" returned: 0 in 0.767s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eb43f3db-b5bc-4233-ada1-77942fddc9b1 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:00 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255 Jul 08 01:28:00 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:01 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eb43f3db-b5bc-4233-ada1-77942fddc9b1 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-0c4341ee-66fb-4a94-b965-65f7bdc5f255" returned: 0 in 0.715s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:01 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eb43f3db-b5bc-4233-ada1-77942fddc9b1 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-0c4341ee-66fb-4a94-b965-65f7bdc5f255" released by "delete_volume" :: held 1.543s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:01 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-eb43f3db-b5bc-4233-ada1-77942fddc9b1 tempest-ProjectReaderTests-1068820401 None] Created reservations ['b0979a82-c276-4c05-a6c3-7002efcc12b9', '598adc53-ed4b-43eb-a088-7d691192445c', 'd8d94da2-6d7f-4191-8eba-747d58ba7a89', '2dcf0d88-7ece-46d2-8c65-b74e63cebdc4'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-eb43f3db-b5bc-4233-ada1-77942fddc9b1 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-eb43f3db-b5bc-4233-ada1-77942fddc9b1 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-eb43f3db-b5bc-4233-ada1-77942fddc9b1 tempest-ProjectReaderTests-1068820401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:01 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-eb43f3db-b5bc-4233-ada1-77942fddc9b1 tempest-ProjectReaderTests-1068820401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-eb43f3db-b5bc-4233-ada1-77942fddc9b1 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eb43f3db-b5bc-4233-ada1-77942fddc9b1 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:01 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:28:01 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:02 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eb43f3db-b5bc-4233-ada1-77942fddc9b1 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.651s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-eb43f3db-b5bc-4233-ada1-77942fddc9b1 tempest-ProjectReaderTests-1068820401 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:02 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-eb43f3db-b5bc-4233-ada1-77942fddc9b1 tempest-ProjectReaderTests-1068820401 None] Deleted volume successfully. Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eb43f3db-b5bc-4233-ada1-77942fddc9b1 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-0c4341ee-66fb-4a94-b965-65f7bdc5f255-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Flow 'volume_create_manager' (fdc1fc45-000f-41a7-a7be-e15d15822000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dda2b807-b0ac-46d7-9d44-f74c03d537b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dda2b807-b0ac-46d7-9d44-f74c03d537b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1698852441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f07320-b620-4824-be0f-ff858f10d35e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ad44f7bcd24ea5addbd641ca3d95ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:02Z,use_quota=True,user_id='19902f8936ff47b98a6bc98e3315b91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af8ba12f-825b-4a0b-bbce-c90aee9aef1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af8ba12f-825b-4a0b-bbce-c90aee9aef1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2269552d-5a24-4935-b68c-ec51b2638eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2269552d-5a24-4935-b68c-ec51b2638eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17f07320-b620-4824-be0f-ff858f10d35e', 'volume_name': 'volume-17f07320-b620-4824-be0f-ff858f10d35e', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffbd3d36-fd19-435d-98b3-031e765c9e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffbd3d36-fd19-435d-98b3-031e765c9e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ec6575-1da2-46e6-8288-202f703b38db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:02 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Volume 17f07320-b620-4824-be0f-ff858f10d35e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17f07320-b620-4824-be0f-ff858f10d35e', 'volume_size': 1} Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1698852441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17f07320-b620-4824-be0f-ff858f10d35e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ad44f7bcd24ea5addbd641ca3d95ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:02Z,use_quota=True,user_id='19902f8936ff47b98a6bc98e3315b91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Creating volume 17f07320-b620-4824-be0f-ff858f10d35e {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:02 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:28:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:02 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e 1073741824 Jul 08 01:28:02 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:03 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e 1073741824" returned: 0 in 0.817s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:03 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e Jul 08 01:28:03 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:04 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e" returned: 0 in 0.617s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:04 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] <== create_volume: return (1478ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ec6575-1da2-46e6-8288-202f703b38db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17f07320-b620-4824-be0f-ff858f10d35e', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6497a6-1b6a-483c-9db0-29f9c70fb839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:04 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Volume volume-17f07320-b620-4824-be0f-ff858f10d35e (17f07320-b620-4824-be0f-ff858f10d35e): created successfully Jul 08 01:28:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e6497a6-1b6a-483c-9db0-29f9c70fb839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:04 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Flow 'volume_create_manager' (fdc1fc45-000f-41a7-a7be-e15d15822000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:04 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-00c9b2f7-d08f-40ef-8643-62ab795ff8fd tempest-ProjectReaderTests-1068820401 None] Created volume successfully. Jul 08 01:28:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ee423822-e9db-4308-acf1-77590430dbe8 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ee423822-e9db-4308-acf1-77590430dbe8 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:04 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-ee423822-e9db-4308-acf1-77590430dbe8 tempest-ProjectReaderTests-1068820401 None] Creating offline snapshot b85d0419-6578-4d6d-8b96-41e942ec1b47 of volume 17f07320-b620-4824-be0f-ff858f10d35e {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:28:04 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f37b316-1b81-41e2-9f46-f844ef07b182]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ee423822-e9db-4308-acf1-77590430dbe8 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:04 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e Jul 08 01:28:04 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:05 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ee423822-e9db-4308-acf1-77590430dbe8 tempest-ProjectReaderTests-1068820401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e" returned: 0 in 0.763s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ee423822-e9db-4308-acf1-77590430dbe8 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.b85d0419-6578-4d6d-8b96-41e942ec1b47 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:05 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.b85d0419-6578-4d6d-8b96-41e942ec1b47 1G Jul 08 01:28:05 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:06 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ee423822-e9db-4308-acf1-77590430dbe8 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.b85d0419-6578-4d6d-8b96-41e942ec1b47 1G" returned: 0 in 0.899s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ee423822-e9db-4308-acf1-77590430dbe8 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17f07320-b620-4824-be0f-ff858f10d35e -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.b85d0419-6578-4d6d-8b96-41e942ec1b47 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:06 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17f07320-b620-4824-be0f-ff858f10d35e -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.b85d0419-6578-4d6d-8b96-41e942ec1b47 Jul 08 01:28:06 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:07 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ee423822-e9db-4308-acf1-77590430dbe8 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17f07320-b620-4824-be0f-ff858f10d35e -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.b85d0419-6578-4d6d-8b96-41e942ec1b47" returned: 0 in 0.789s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:07 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-ee423822-e9db-4308-acf1-77590430dbe8 tempest-ProjectReaderTests-1068820401 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.b85d0419-6578-4d6d-8b96-41e942ec1b47 is being set with open permissions: ugo+rw Jul 08 01:28:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ee423822-e9db-4308-acf1-77590430dbe8 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.b85d0419-6578-4d6d-8b96-41e942ec1b47 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:07 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.b85d0419-6578-4d6d-8b96-41e942ec1b47 Jul 08 01:28:07 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:07 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ee423822-e9db-4308-acf1-77590430dbe8 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.b85d0419-6578-4d6d-8b96-41e942ec1b47" returned: 0 in 0.737s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ee423822-e9db-4308-acf1-77590430dbe8 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:08 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.info Jul 08 01:28:08 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:08 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ee423822-e9db-4308-acf1-77590430dbe8 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.info" returned: 0 in 0.724s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:08 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-ee423822-e9db-4308-acf1-77590430dbe8 tempest-ProjectReaderTests-1068820401 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.info is being set with open permissions: ugo+rw Jul 08 01:28:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ee423822-e9db-4308-acf1-77590430dbe8 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:08 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.info Jul 08 01:28:08 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:09 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-ee423822-e9db-4308-acf1-77590430dbe8 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.info" returned: 0 in 0.702s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-ee423822-e9db-4308-acf1-77590430dbe8 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.696s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:09 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-ee423822-e9db-4308-acf1-77590430dbe8 tempest-ProjectReaderTests-1068820401 None] Create snapshot completed successfully Jul 08 01:28:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-63199521-c9aa-41d2-b775-c5931dbda200 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-b85d0419-6578-4d6d-8b96-41e942ec1b47-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-63199521-c9aa-41d2-b775-c5931dbda200 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-b85d0419-6578-4d6d-8b96-41e942ec1b47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-63199521-c9aa-41d2-b775-c5931dbda200 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-quobyte-17f07320-b620-4824-be0f-ff858f10d35e" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-63199521-c9aa-41d2-b775-c5931dbda200 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-17f07320-b620-4824-be0f-ff858f10d35e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-63199521-c9aa-41d2-b775-c5931dbda200 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-quobyte-b85d0419-6578-4d6d-8b96-41e942ec1b47" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-63199521-c9aa-41d2-b775-c5931dbda200 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-b85d0419-6578-4d6d-8b96-41e942ec1b47" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:10 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-63199521-c9aa-41d2-b775-c5931dbda200 tempest-ProjectReaderTests-1068820401 None] Deleting offline snapshot b85d0419-6578-4d6d-8b96-41e942ec1b47 of volume 17f07320-b620-4824-be0f-ff858f10d35e {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:28:10 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-63199521-c9aa-41d2-b775-c5931dbda200 tempest-ProjectReaderTests-1068820401 None] snapshot_file for this snap is: volume-17f07320-b620-4824-be0f-ff858f10d35e.b85d0419-6578-4d6d-8b96-41e942ec1b47 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:28:10 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29b505b-8e91-40c9-9907-6ef3fa7d61e5]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63199521-c9aa-41d2-b775-c5931dbda200 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.b85d0419-6578-4d6d-8b96-41e942ec1b47 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:10 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.b85d0419-6578-4d6d-8b96-41e942ec1b47 Jul 08 01:28:10 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:10 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63199521-c9aa-41d2-b775-c5931dbda200 tempest-ProjectReaderTests-1068820401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.b85d0419-6578-4d6d-8b96-41e942ec1b47" returned: 0 in 0.849s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:10 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-63199521-c9aa-41d2-b775-c5931dbda200 tempest-ProjectReaderTests-1068820401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17f07320-b620-4824-be0f-ff858f10d35e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:28:10 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b14a699-0767-4f84-ad76-e2c31dbe0247]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63199521-c9aa-41d2-b775-c5931dbda200 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:11 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e Jul 08 01:28:11 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:11 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63199521-c9aa-41d2-b775-c5931dbda200 tempest-ProjectReaderTests-1068820401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e" returned: 0 in 0.821s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:11 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63199521-c9aa-41d2-b775-c5931dbda200 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.b85d0419-6578-4d6d-8b96-41e942ec1b47 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:11 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.b85d0419-6578-4d6d-8b96-41e942ec1b47 Jul 08 01:28:11 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:12 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63199521-c9aa-41d2-b775-c5931dbda200 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.b85d0419-6578-4d6d-8b96-41e942ec1b47" returned: 0 in 0.769s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:12 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63199521-c9aa-41d2-b775-c5931dbda200 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.b85d0419-6578-4d6d-8b96-41e942ec1b47 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:12 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.b85d0419-6578-4d6d-8b96-41e942ec1b47 Jul 08 01:28:12 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:13 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:13 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63199521-c9aa-41d2-b775-c5931dbda200 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e.b85d0419-6578-4d6d-8b96-41e942ec1b47" returned: 0 in 0.704s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-63199521-c9aa-41d2-b775-c5931dbda200 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-b85d0419-6578-4d6d-8b96-41e942ec1b47" released by "_delete_snapshot" :: held 3.247s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-63199521-c9aa-41d2-b775-c5931dbda200 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-17f07320-b620-4824-be0f-ff858f10d35e" released by "delete_snapshot" :: held 3.274s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:13 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-63199521-c9aa-41d2-b775-c5931dbda200 tempest-ProjectReaderTests-1068820401 None] Created reservations ['46e05d45-f572-4d9e-a5cc-20d09a43dd90', '7edc083e-153e-48d0-bba6-4a15723e0f52', 'b1ba99a4-757c-47b0-90ad-184992cab68d', '634f83b3-943e-4de1-b40f-60f4302290bd'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:13 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-63199521-c9aa-41d2-b775-c5931dbda200 tempest-ProjectReaderTests-1068820401 None] Delete snapshot completed successfully. Jul 08 01:28:13 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-63199521-c9aa-41d2-b775-c5931dbda200 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-b85d0419-6578-4d6d-8b96-41e942ec1b47-delete_snapshot" released by "delete_snapshot" :: held 3.437s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1fd702ef-c3f0-4f49-8125-26beb767a935 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-17f07320-b620-4824-be0f-ff858f10d35e-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1fd702ef-c3f0-4f49-8125-26beb767a935 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-17f07320-b620-4824-be0f-ff858f10d35e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1fd702ef-c3f0-4f49-8125-26beb767a935 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-quobyte-17f07320-b620-4824-be0f-ff858f10d35e" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:14 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1fd702ef-c3f0-4f49-8125-26beb767a935 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-17f07320-b620-4824-be0f-ff858f10d35e" acquired by "delete_volume" :: waited 0.024s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:14 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[c81145d6-8896-4964-a675-51fe6057bd39]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:14 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1fd702ef-c3f0-4f49-8125-26beb767a935 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:14 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e Jul 08 01:28:14 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:15 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1fd702ef-c3f0-4f49-8125-26beb767a935 tempest-ProjectReaderTests-1068820401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e" returned: 0 in 0.794s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1fd702ef-c3f0-4f49-8125-26beb767a935 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:15 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e Jul 08 01:28:15 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:15 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1fd702ef-c3f0-4f49-8125-26beb767a935 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-17f07320-b620-4824-be0f-ff858f10d35e" returned: 0 in 0.654s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:15 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1fd702ef-c3f0-4f49-8125-26beb767a935 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-17f07320-b620-4824-be0f-ff858f10d35e" released by "delete_volume" :: held 1.515s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:15 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-1fd702ef-c3f0-4f49-8125-26beb767a935 tempest-ProjectReaderTests-1068820401 None] Created reservations ['afe75bbe-8f19-4804-8530-7a017a5f0e25', '564d2474-07fe-4c15-a0b9-7073cb7ea3f3', '354db8f1-8eec-44cc-a3e4-a4e68ac05c2d', 'c3542809-4391-4c0d-80ca-2da196b99df5'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1fd702ef-c3f0-4f49-8125-26beb767a935 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1fd702ef-c3f0-4f49-8125-26beb767a935 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1fd702ef-c3f0-4f49-8125-26beb767a935 tempest-ProjectReaderTests-1068820401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:15 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-1fd702ef-c3f0-4f49-8125-26beb767a935 tempest-ProjectReaderTests-1068820401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-1fd702ef-c3f0-4f49-8125-26beb767a935 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:15 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1fd702ef-c3f0-4f49-8125-26beb767a935 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:16 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:28:16 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:16 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:16 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-1fd702ef-c3f0-4f49-8125-26beb767a935 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.679s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:16 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-1fd702ef-c3f0-4f49-8125-26beb767a935 tempest-ProjectReaderTests-1068820401 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:16 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-1fd702ef-c3f0-4f49-8125-26beb767a935 tempest-ProjectReaderTests-1068820401 None] Deleted volume successfully. Jul 08 01:28:16 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-1fd702ef-c3f0-4f49-8125-26beb767a935 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-17f07320-b620-4824-be0f-ff858f10d35e-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Flow 'volume_create_manager' (0832a70e-8897-4aab-a81a-b4ab3160a397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28666b2-9645-49f0-beaf-4a9ce8bf6f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f28666b2-9645-49f0-beaf-4a9ce8bf6f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1919707198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3acccf0d-8209-412d-8b32-fe9508a87f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ad44f7bcd24ea5addbd641ca3d95ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:17Z,use_quota=True,user_id='19902f8936ff47b98a6bc98e3315b91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b2847fe-beb7-4be3-90db-72938133f0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b2847fe-beb7-4be3-90db-72938133f0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5f550d-d80c-4f21-b82a-c6f41797ea16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac5f550d-d80c-4f21-b82a-c6f41797ea16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3acccf0d-8209-412d-8b32-fe9508a87f61', 'volume_name': 'volume-3acccf0d-8209-412d-8b32-fe9508a87f61', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c0cbb0-3ef3-431e-a448-b1cb5ac7cad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3c0cbb0-3ef3-431e-a448-b1cb5ac7cad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b6a3bb-7651-4d0b-a49d-37d0266f2a14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:17 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Volume 3acccf0d-8209-412d-8b32-fe9508a87f61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3acccf0d-8209-412d-8b32-fe9508a87f61', 'volume_size': 1} Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1919707198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3acccf0d-8209-412d-8b32-fe9508a87f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ad44f7bcd24ea5addbd641ca3d95ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:17Z,use_quota=True,user_id='19902f8936ff47b98a6bc98e3315b91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Creating volume 3acccf0d-8209-412d-8b32-fe9508a87f61 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:17 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:17 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61 1073741824 Jul 08 01:28:17 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:17 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61 1073741824" returned: 0 in 0.863s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:17 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:18 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61 Jul 08 01:28:18 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:18 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61" returned: 0 in 0.705s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:18 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:18 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11b6a3bb-7651-4d0b-a49d-37d0266f2a14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3acccf0d-8209-412d-8b32-fe9508a87f61', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aaac006-e284-4013-9493-021ec4c1a095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:18 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Volume volume-3acccf0d-8209-412d-8b32-fe9508a87f61 (3acccf0d-8209-412d-8b32-fe9508a87f61): created successfully Jul 08 01:28:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aaac006-e284-4013-9493-021ec4c1a095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:18 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Flow 'volume_create_manager' (0832a70e-8897-4aab-a81a-b4ab3160a397) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:18 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f6e0d420-3f19-4581-884c-10257296ef1a tempest-ProjectReaderTests-1068820401 None] Created volume successfully. Jul 08 01:28:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9ababdbd-615d-4ded-a83d-bca3b4538e3b tempest-ProjectReaderTests-1068820401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9ababdbd-615d-4ded-a83d-bca3b4538e3b tempest-ProjectReaderTests-1068820401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:19 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-9ababdbd-615d-4ded-a83d-bca3b4538e3b tempest-ProjectReaderTests-1068820401 None] Creating offline snapshot 3df63907-b097-4696-9cf7-2351bbd3d969 of volume 3acccf0d-8209-412d-8b32-fe9508a87f61 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:28:19 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a5d7b2-3ad1-4b60-b483-80566b98e133]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:19 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9ababdbd-615d-4ded-a83d-bca3b4538e3b tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:19 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61 Jul 08 01:28:19 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:20 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9ababdbd-615d-4ded-a83d-bca3b4538e3b tempest-ProjectReaderTests-1068820401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61" returned: 0 in 0.807s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9ababdbd-615d-4ded-a83d-bca3b4538e3b tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.3df63907-b097-4696-9cf7-2351bbd3d969 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:20 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.3df63907-b097-4696-9cf7-2351bbd3d969 1G Jul 08 01:28:20 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:20 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9ababdbd-615d-4ded-a83d-bca3b4538e3b tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.3df63907-b097-4696-9cf7-2351bbd3d969 1G" returned: 0 in 0.841s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:20 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9ababdbd-615d-4ded-a83d-bca3b4538e3b tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3acccf0d-8209-412d-8b32-fe9508a87f61 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.3df63907-b097-4696-9cf7-2351bbd3d969 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:20 devstack sudo[107213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3acccf0d-8209-412d-8b32-fe9508a87f61 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.3df63907-b097-4696-9cf7-2351bbd3d969 Jul 08 01:28:20 devstack sudo[107213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:21 devstack sudo[107213]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9ababdbd-615d-4ded-a83d-bca3b4538e3b tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3acccf0d-8209-412d-8b32-fe9508a87f61 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.3df63907-b097-4696-9cf7-2351bbd3d969" returned: 0 in 0.718s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:21 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-9ababdbd-615d-4ded-a83d-bca3b4538e3b tempest-ProjectReaderTests-1068820401 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.3df63907-b097-4696-9cf7-2351bbd3d969 is being set with open permissions: ugo+rw Jul 08 01:28:21 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9ababdbd-615d-4ded-a83d-bca3b4538e3b tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.3df63907-b097-4696-9cf7-2351bbd3d969 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:21 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.3df63907-b097-4696-9cf7-2351bbd3d969 Jul 08 01:28:21 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:22 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9ababdbd-615d-4ded-a83d-bca3b4538e3b tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.3df63907-b097-4696-9cf7-2351bbd3d969" returned: 0 in 0.720s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:22 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9ababdbd-615d-4ded-a83d-bca3b4538e3b tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:22 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.info Jul 08 01:28:22 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:23 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9ababdbd-615d-4ded-a83d-bca3b4538e3b tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.info" returned: 0 in 0.771s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:23 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-9ababdbd-615d-4ded-a83d-bca3b4538e3b tempest-ProjectReaderTests-1068820401 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.info is being set with open permissions: ugo+rw Jul 08 01:28:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9ababdbd-615d-4ded-a83d-bca3b4538e3b tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:23 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.info Jul 08 01:28:23 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:23 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-9ababdbd-615d-4ded-a83d-bca3b4538e3b tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.info" returned: 0 in 0.675s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:23 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-9ababdbd-615d-4ded-a83d-bca3b4538e3b tempest-ProjectReaderTests-1068820401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.621s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:23 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-9ababdbd-615d-4ded-a83d-bca3b4538e3b tempest-ProjectReaderTests-1068820401 None] Create snapshot completed successfully Jul 08 01:28:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e98a3ed9-bfcd-4c51-81c9-22b32d67f3f9 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-3df63907-b097-4696-9cf7-2351bbd3d969-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e98a3ed9-bfcd-4c51-81c9-22b32d67f3f9 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-3df63907-b097-4696-9cf7-2351bbd3d969-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e98a3ed9-bfcd-4c51-81c9-22b32d67f3f9 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-quobyte-3acccf0d-8209-412d-8b32-fe9508a87f61" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e98a3ed9-bfcd-4c51-81c9-22b32d67f3f9 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-3acccf0d-8209-412d-8b32-fe9508a87f61" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e98a3ed9-bfcd-4c51-81c9-22b32d67f3f9 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-quobyte-3df63907-b097-4696-9cf7-2351bbd3d969" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:24 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e98a3ed9-bfcd-4c51-81c9-22b32d67f3f9 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-3df63907-b097-4696-9cf7-2351bbd3d969" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-e98a3ed9-bfcd-4c51-81c9-22b32d67f3f9 tempest-ProjectReaderTests-1068820401 None] Deleting offline snapshot 3df63907-b097-4696-9cf7-2351bbd3d969 of volume 3acccf0d-8209-412d-8b32-fe9508a87f61 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:28:24 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-e98a3ed9-bfcd-4c51-81c9-22b32d67f3f9 tempest-ProjectReaderTests-1068820401 None] snapshot_file for this snap is: volume-3acccf0d-8209-412d-8b32-fe9508a87f61.3df63907-b097-4696-9cf7-2351bbd3d969 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:28:24 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b19ffe5-2d2e-495b-a39d-8904bc4c9718]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:24 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e98a3ed9-bfcd-4c51-81c9-22b32d67f3f9 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.3df63907-b097-4696-9cf7-2351bbd3d969 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:24 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.3df63907-b097-4696-9cf7-2351bbd3d969 Jul 08 01:28:24 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:25 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e98a3ed9-bfcd-4c51-81c9-22b32d67f3f9 tempest-ProjectReaderTests-1068820401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.3df63907-b097-4696-9cf7-2351bbd3d969" returned: 0 in 0.756s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:25 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-e98a3ed9-bfcd-4c51-81c9-22b32d67f3f9 tempest-ProjectReaderTests-1068820401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3acccf0d-8209-412d-8b32-fe9508a87f61(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:28:25 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b614389-9b52-4227-827d-6e128c91518c]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:25 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e98a3ed9-bfcd-4c51-81c9-22b32d67f3f9 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:25 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61 Jul 08 01:28:25 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:26 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e98a3ed9-bfcd-4c51-81c9-22b32d67f3f9 tempest-ProjectReaderTests-1068820401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61" returned: 0 in 0.820s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:26 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e98a3ed9-bfcd-4c51-81c9-22b32d67f3f9 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.3df63907-b097-4696-9cf7-2351bbd3d969 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:26 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.3df63907-b097-4696-9cf7-2351bbd3d969 Jul 08 01:28:26 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:26 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e98a3ed9-bfcd-4c51-81c9-22b32d67f3f9 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.3df63907-b097-4696-9cf7-2351bbd3d969" returned: 0 in 0.777s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e98a3ed9-bfcd-4c51-81c9-22b32d67f3f9 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.3df63907-b097-4696-9cf7-2351bbd3d969 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:27 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.3df63907-b097-4696-9cf7-2351bbd3d969 Jul 08 01:28:27 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:27 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:27 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e98a3ed9-bfcd-4c51-81c9-22b32d67f3f9 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61.3df63907-b097-4696-9cf7-2351bbd3d969" returned: 0 in 0.694s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:27 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e98a3ed9-bfcd-4c51-81c9-22b32d67f3f9 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-3df63907-b097-4696-9cf7-2351bbd3d969" released by "_delete_snapshot" :: held 3.144s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:27 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e98a3ed9-bfcd-4c51-81c9-22b32d67f3f9 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-3acccf0d-8209-412d-8b32-fe9508a87f61" released by "delete_snapshot" :: held 3.169s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:27 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-e98a3ed9-bfcd-4c51-81c9-22b32d67f3f9 tempest-ProjectReaderTests-1068820401 None] Created reservations ['cae159c6-3914-4919-8c1f-d11f92745e0d', 'fc01b5fc-a158-40fa-8488-a84601b3dfd7', 'e2462d89-5c1f-477b-ba48-529687d690ad', 'c1950a46-0c28-4a82-a68d-341a53d5d51c'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:27 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-e98a3ed9-bfcd-4c51-81c9-22b32d67f3f9 tempest-ProjectReaderTests-1068820401 None] Delete snapshot completed successfully. Jul 08 01:28:27 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e98a3ed9-bfcd-4c51-81c9-22b32d67f3f9 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-3df63907-b097-4696-9cf7-2351bbd3d969-delete_snapshot" released by "delete_snapshot" :: held 3.346s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f7217547-453a-49e2-97a4-49f5b82fb240 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-3acccf0d-8209-412d-8b32-fe9508a87f61-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f7217547-453a-49e2-97a4-49f5b82fb240 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-3acccf0d-8209-412d-8b32-fe9508a87f61-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f7217547-453a-49e2-97a4-49f5b82fb240 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-quobyte-3acccf0d-8209-412d-8b32-fe9508a87f61" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:28 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f7217547-453a-49e2-97a4-49f5b82fb240 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-3acccf0d-8209-412d-8b32-fe9508a87f61" acquired by "delete_volume" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:28 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad38c97b-dacb-4f7b-8068-afd7ad069aa6]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:28 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f7217547-453a-49e2-97a4-49f5b82fb240 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:29 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61 Jul 08 01:28:29 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:29 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f7217547-453a-49e2-97a4-49f5b82fb240 tempest-ProjectReaderTests-1068820401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61" returned: 0 in 0.820s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:29 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f7217547-453a-49e2-97a4-49f5b82fb240 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:29 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61 Jul 08 01:28:29 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:30 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f7217547-453a-49e2-97a4-49f5b82fb240 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-3acccf0d-8209-412d-8b32-fe9508a87f61" returned: 0 in 0.692s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:30 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f7217547-453a-49e2-97a4-49f5b82fb240 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-3acccf0d-8209-412d-8b32-fe9508a87f61" released by "delete_volume" :: held 1.591s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:30 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-f7217547-453a-49e2-97a4-49f5b82fb240 tempest-ProjectReaderTests-1068820401 None] Created reservations ['c98d1be1-44d2-4f43-a1b0-48e28eb29fef', 'e8bfb73e-09a6-41a1-b1ef-dc39b8ca07f4', 'b5f13be9-e7d4-4da8-812d-319abf92e0d7', '092ce307-ba0e-4d92-b11e-4dea6d7573b2'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f7217547-453a-49e2-97a4-49f5b82fb240 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f7217547-453a-49e2-97a4-49f5b82fb240 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f7217547-453a-49e2-97a4-49f5b82fb240 tempest-ProjectReaderTests-1068820401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:30 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-f7217547-453a-49e2-97a4-49f5b82fb240 tempest-ProjectReaderTests-1068820401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f7217547-453a-49e2-97a4-49f5b82fb240 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:30 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f7217547-453a-49e2-97a4-49f5b82fb240 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:30 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:28:30 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:31 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f7217547-453a-49e2-97a4-49f5b82fb240 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.662s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-f7217547-453a-49e2-97a4-49f5b82fb240 tempest-ProjectReaderTests-1068820401 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:31 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f7217547-453a-49e2-97a4-49f5b82fb240 tempest-ProjectReaderTests-1068820401 None] Deleted volume successfully. Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-f7217547-453a-49e2-97a4-49f5b82fb240 tempest-ProjectReaderTests-1068820401 None] Lock "cinder-3acccf0d-8209-412d-8b32-fe9508a87f61-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Flow 'volume_create_manager' (1be5db7e-ba17-4363-8314-b5db80f29aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ba4ff5-d5fc-469a-8087-64e2214e9e41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ba4ff5-d5fc-469a-8087-64e2214e9e41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1576242001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29917cb2-03d8-4ac8-a248-630591109c56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ad44f7bcd24ea5addbd641ca3d95ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:31Z,use_quota=True,user_id='19902f8936ff47b98a6bc98e3315b91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ef3671-864e-4173-9981-d5e3a90e6f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ef3671-864e-4173-9981-d5e3a90e6f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8fc6539-9e30-4c4b-8986-6e4b982a1ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8fc6539-9e30-4c4b-8986-6e4b982a1ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29917cb2-03d8-4ac8-a248-630591109c56', 'volume_name': 'volume-29917cb2-03d8-4ac8-a248-630591109c56', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee87f38-32e3-4aa2-842a-ffbc10f68c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aee87f38-32e3-4aa2-842a-ffbc10f68c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c7a61f-5212-4f92-b011-39aa6b52b48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:31 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Volume 29917cb2-03d8-4ac8-a248-630591109c56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29917cb2-03d8-4ac8-a248-630591109c56', 'volume_size': 1} Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1576242001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29917cb2-03d8-4ac8-a248-630591109c56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3ad44f7bcd24ea5addbd641ca3d95ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:31Z,use_quota=True,user_id='19902f8936ff47b98a6bc98e3315b91a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Creating volume 29917cb2-03d8-4ac8-a248-630591109c56 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:31 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:28:31 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:31 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56 1073741824 Jul 08 01:28:31 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:32 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56 1073741824" returned: 0 in 0.865s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:32 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:32 devstack sudo[107308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56 Jul 08 01:28:32 devstack sudo[107308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:33 devstack sudo[107308]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56" returned: 0 in 0.639s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78c7a61f-5212-4f92-b011-39aa6b52b48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29917cb2-03d8-4ac8-a248-630591109c56', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507b2624-0616-47d4-a60b-daa4affa7ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:33 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Volume volume-29917cb2-03d8-4ac8-a248-630591109c56 (29917cb2-03d8-4ac8-a248-630591109c56): created successfully Jul 08 01:28:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (507b2624-0616-47d4-a60b-daa4affa7ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:33 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Flow 'volume_create_manager' (1be5db7e-ba17-4363-8314-b5db80f29aed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:33 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-d8dbc237-8f4b-4c5c-b68b-c7f641304e63 tempest-ProjectReaderTests-1068820401 None] Created volume successfully. Jul 08 01:28:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f440df1e-a596-4022-8abd-413bf616fe82 tempest-ProjectReaderTests-1068820401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f440df1e-a596-4022-8abd-413bf616fe82 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:33 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-f440df1e-a596-4022-8abd-413bf616fe82 tempest-ProjectReaderTests-1068820401 None] Creating offline snapshot 1c0af47c-416c-4c13-9f72-e4928de72efc of volume 29917cb2-03d8-4ac8-a248-630591109c56 {{(pid=87123) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 08 01:28:33 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fe03e0-d040-4dc5-865a-acb117d86a85]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:33 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f440df1e-a596-4022-8abd-413bf616fe82 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:33 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56 Jul 08 01:28:33 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:34 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f440df1e-a596-4022-8abd-413bf616fe82 tempest-ProjectReaderTests-1068820401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56" returned: 0 in 0.827s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:34 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f440df1e-a596-4022-8abd-413bf616fe82 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.1c0af47c-416c-4c13-9f72-e4928de72efc 1G {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:34 devstack sudo[107316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.1c0af47c-416c-4c13-9f72-e4928de72efc 1G Jul 08 01:28:34 devstack sudo[107316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:35 devstack sudo[107316]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f440df1e-a596-4022-8abd-413bf616fe82 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.1c0af47c-416c-4c13-9f72-e4928de72efc 1G" returned: 0 in 0.890s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:35 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f440df1e-a596-4022-8abd-413bf616fe82 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29917cb2-03d8-4ac8-a248-630591109c56 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.1c0af47c-416c-4c13-9f72-e4928de72efc {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:35 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29917cb2-03d8-4ac8-a248-630591109c56 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.1c0af47c-416c-4c13-9f72-e4928de72efc Jul 08 01:28:35 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:36 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f440df1e-a596-4022-8abd-413bf616fe82 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29917cb2-03d8-4ac8-a248-630591109c56 -F qcow2 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.1c0af47c-416c-4c13-9f72-e4928de72efc" returned: 0 in 0.696s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:36 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-f440df1e-a596-4022-8abd-413bf616fe82 tempest-ProjectReaderTests-1068820401 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.1c0af47c-416c-4c13-9f72-e4928de72efc is being set with open permissions: ugo+rw Jul 08 01:28:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f440df1e-a596-4022-8abd-413bf616fe82 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.1c0af47c-416c-4c13-9f72-e4928de72efc {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:36 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.1c0af47c-416c-4c13-9f72-e4928de72efc Jul 08 01:28:36 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:36 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f440df1e-a596-4022-8abd-413bf616fe82 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.1c0af47c-416c-4c13-9f72-e4928de72efc" returned: 0 in 0.647s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:36 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f440df1e-a596-4022-8abd-413bf616fe82 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:36 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.info Jul 08 01:28:36 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:37 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f440df1e-a596-4022-8abd-413bf616fe82 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.info" returned: 0 in 0.686s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:37 devstack cinder-volume[87123]: WARNING cinder.volume.drivers.remotefs [None req-f440df1e-a596-4022-8abd-413bf616fe82 tempest-ProjectReaderTests-1068820401 None] /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.info is being set with open permissions: ugo+rw Jul 08 01:28:37 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f440df1e-a596-4022-8abd-413bf616fe82 tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.info {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:37 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.info Jul 08 01:28:37 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:38 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-f440df1e-a596-4022-8abd-413bf616fe82 tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.info" returned: 0 in 0.639s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:38 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-f440df1e-a596-4022-8abd-413bf616fe82 tempest-ProjectReaderTests-1068820401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.468s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:38 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-f440df1e-a596-4022-8abd-413bf616fe82 tempest-ProjectReaderTests-1068820401 None] Create snapshot completed successfully Jul 08 01:28:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4cbbe340-e058-4fb9-968e-0ce47a67b27b tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-1c0af47c-416c-4c13-9f72-e4928de72efc-delete_snapshot" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4cbbe340-e058-4fb9-968e-0ce47a67b27b tempest-ProjectReaderTests-1068820401 None] Lock "cinder-1c0af47c-416c-4c13-9f72-e4928de72efc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4cbbe340-e058-4fb9-968e-0ce47a67b27b tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-quobyte-29917cb2-03d8-4ac8-a248-630591109c56" by "delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4cbbe340-e058-4fb9-968e-0ce47a67b27b tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-29917cb2-03d8-4ac8-a248-630591109c56" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4cbbe340-e058-4fb9-968e-0ce47a67b27b tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-quobyte-1c0af47c-416c-4c13-9f72-e4928de72efc" by "_delete_snapshot" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:40 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4cbbe340-e058-4fb9-968e-0ce47a67b27b tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-1c0af47c-416c-4c13-9f72-e4928de72efc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-4cbbe340-e058-4fb9-968e-0ce47a67b27b tempest-ProjectReaderTests-1068820401 None] Deleting offline snapshot 1c0af47c-416c-4c13-9f72-e4928de72efc of volume 29917cb2-03d8-4ac8-a248-630591109c56 {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 08 01:28:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-4cbbe340-e058-4fb9-968e-0ce47a67b27b tempest-ProjectReaderTests-1068820401 None] snapshot_file for this snap is: volume-29917cb2-03d8-4ac8-a248-630591109c56.1c0af47c-416c-4c13-9f72-e4928de72efc {{(pid=87123) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 08 01:28:40 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd11a97-2e76-436d-8878-8ef2c881560f]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4cbbe340-e058-4fb9-968e-0ce47a67b27b tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.1c0af47c-416c-4c13-9f72-e4928de72efc {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:40 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.1c0af47c-416c-4c13-9f72-e4928de72efc Jul 08 01:28:40 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:40 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:40 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4cbbe340-e058-4fb9-968e-0ce47a67b27b tempest-ProjectReaderTests-1068820401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.1c0af47c-416c-4c13-9f72-e4928de72efc" returned: 0 in 0.757s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:40 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-4cbbe340-e058-4fb9-968e-0ce47a67b27b tempest-ProjectReaderTests-1068820401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29917cb2-03d8-4ac8-a248-630591109c56(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87123) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 08 01:28:41 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a1f8bf-ccc5-4e3c-8e4e-72a1fa85dc41]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4cbbe340-e058-4fb9-968e-0ce47a67b27b tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:41 devstack sudo[107342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56 Jul 08 01:28:41 devstack sudo[107342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:41 devstack sudo[107342]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4cbbe340-e058-4fb9-968e-0ce47a67b27b tempest-ProjectReaderTests-1068820401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56" returned: 0 in 0.764s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:41 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4cbbe340-e058-4fb9-968e-0ce47a67b27b tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.1c0af47c-416c-4c13-9f72-e4928de72efc {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:41 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.1c0af47c-416c-4c13-9f72-e4928de72efc Jul 08 01:28:41 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:42 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4cbbe340-e058-4fb9-968e-0ce47a67b27b tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.1c0af47c-416c-4c13-9f72-e4928de72efc" returned: 0 in 0.757s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:42 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4cbbe340-e058-4fb9-968e-0ce47a67b27b tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.1c0af47c-416c-4c13-9f72-e4928de72efc {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:42 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.1c0af47c-416c-4c13-9f72-e4928de72efc Jul 08 01:28:42 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:43 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:43 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4cbbe340-e058-4fb9-968e-0ce47a67b27b tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56.1c0af47c-416c-4c13-9f72-e4928de72efc" returned: 0 in 0.652s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4cbbe340-e058-4fb9-968e-0ce47a67b27b tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-1c0af47c-416c-4c13-9f72-e4928de72efc" released by "_delete_snapshot" :: held 3.028s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:43 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4cbbe340-e058-4fb9-968e-0ce47a67b27b tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-29917cb2-03d8-4ac8-a248-630591109c56" released by "delete_snapshot" :: held 3.051s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:43 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=52,cinder:INSERT=24,cinder:UPDATE=79,cinder:DELETE=6 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:28:43 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:INSERT=16,cinder:UPDATE=65,cinder:SELECT=60,cinder:DELETE=6 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:28:43 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-4cbbe340-e058-4fb9-968e-0ce47a67b27b tempest-ProjectReaderTests-1068820401 None] Created reservations ['491ead32-6352-4c35-980e-5bc2a0a16445', 'cebf4cc7-a2de-41b2-9adc-e39c874d7e83', 'b8f059c5-d065-4cd6-b6c9-ca75aa25fe79', '7223f3a2-1bc2-4c02-8781-67414ed8e0b1'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:44 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-4cbbe340-e058-4fb9-968e-0ce47a67b27b tempest-ProjectReaderTests-1068820401 None] Delete snapshot completed successfully. Jul 08 01:28:44 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-4cbbe340-e058-4fb9-968e-0ce47a67b27b tempest-ProjectReaderTests-1068820401 None] Lock "cinder-1c0af47c-416c-4c13-9f72-e4928de72efc-delete_snapshot" released by "delete_snapshot" :: held 4.484s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:44 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:28:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:44 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:44 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:44 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:28:44 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:45 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b269496c-e706-4fcc-8d27-25f709e9832d tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-29917cb2-03d8-4ac8-a248-630591109c56-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:45 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b269496c-e706-4fcc-8d27-25f709e9832d tempest-ProjectReaderTests-1068820401 None] Lock "cinder-29917cb2-03d8-4ac8-a248-630591109c56-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:45 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b269496c-e706-4fcc-8d27-25f709e9832d tempest-ProjectReaderTests-1068820401 None] Acquiring lock "cinder-quobyte-29917cb2-03d8-4ac8-a248-630591109c56" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:45 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b269496c-e706-4fcc-8d27-25f709e9832d tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-29917cb2-03d8-4ac8-a248-630591109c56" acquired by "delete_volume" :: waited 0.025s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:45 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9aa817-07b0-4031-9781-aa432824850c]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b269496c-e706-4fcc-8d27-25f709e9832d tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:45 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56 Jul 08 01:28:45 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:45 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:45 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.704s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:45 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:45 devstack cinder-volume[87123]: DEBUG oslo_service.periodic_task [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] Running periodic task VolumeManager._thread_info {{(pid=87123) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 08 01:28:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread count: 28 {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 08 01:28:45 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-63ba2024-f81e-4bf7-b53e-1689eba10ce1 None None] thread info: [<_MainThread(MainThread, started 123512636084352)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87123) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 08 01:28:46 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b269496c-e706-4fcc-8d27-25f709e9832d tempest-ProjectReaderTests-1068820401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56" returned: 0 in 0.796s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b269496c-e706-4fcc-8d27-25f709e9832d tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:46 devstack sudo[107366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56 Jul 08 01:28:46 devstack sudo[107366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:46 devstack sudo[107366]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b269496c-e706-4fcc-8d27-25f709e9832d tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-29917cb2-03d8-4ac8-a248-630591109c56" returned: 0 in 0.641s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:46 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b269496c-e706-4fcc-8d27-25f709e9832d tempest-ProjectReaderTests-1068820401 None] Lock "cinder-quobyte-29917cb2-03d8-4ac8-a248-630591109c56" released by "delete_volume" :: held 1.512s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:46 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-b269496c-e706-4fcc-8d27-25f709e9832d tempest-ProjectReaderTests-1068820401 None] Created reservations ['dde6f653-8e92-4300-8e0c-8766127150d4', '53264aba-8f2f-4c2d-b756-ea4122efbd1f', '2409bb8c-15da-4dc3-ab6b-94652ddc47dd', 'f42ec30c-7196-4eea-b79d-d26afc859454'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b269496c-e706-4fcc-8d27-25f709e9832d tempest-ProjectReaderTests-1068820401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b269496c-e706-4fcc-8d27-25f709e9832d tempest-ProjectReaderTests-1068820401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b269496c-e706-4fcc-8d27-25f709e9832d tempest-ProjectReaderTests-1068820401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:46 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b269496c-e706-4fcc-8d27-25f709e9832d tempest-ProjectReaderTests-1068820401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b269496c-e706-4fcc-8d27-25f709e9832d tempest-ProjectReaderTests-1068820401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:46 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b269496c-e706-4fcc-8d27-25f709e9832d tempest-ProjectReaderTests-1068820401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:46 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:28:46 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:47 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:47 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b269496c-e706-4fcc-8d27-25f709e9832d tempest-ProjectReaderTests-1068820401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.645s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:47 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-b269496c-e706-4fcc-8d27-25f709e9832d tempest-ProjectReaderTests-1068820401 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:47 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b269496c-e706-4fcc-8d27-25f709e9832d tempest-ProjectReaderTests-1068820401 None] Deleted volume successfully. Jul 08 01:28:47 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-b269496c-e706-4fcc-8d27-25f709e9832d tempest-ProjectReaderTests-1068820401 None] Lock "cinder-29917cb2-03d8-4ac8-a248-630591109c56-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:50 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:50 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Flow 'volume_create_manager' (9ae1aef3-981b-4529-8777-77847441e14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:50 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6ae0c3-615f-4505-becc-eb16db0e2050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b6ae0c3-615f-4505-becc-eb16db0e2050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-277186834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='011918b2a9304d4cbc6a650207b80e28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:51Z,use_quota=True,user_id='4e7034d4d4aa4a64afc5992f8963f714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923d0274-8c05-4240-a770-47a444f64388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923d0274-8c05-4240-a770-47a444f64388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa9d2bf-2125-41f3-a004-3cd4fcbd4837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa9d2bf-2125-41f3-a004-3cd4fcbd4837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7', 'volume_name': 'volume-b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80584212-6b7e-4c37-a337-cbdd1c859c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80584212-6b7e-4c37-a337-cbdd1c859c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:51 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbfa2cd-f5ca-49e0-85c9-2d7de4bb0e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:51 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Volume b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7', 'volume_size': 1} Jul 08 01:28:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-277186834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='011918b2a9304d4cbc6a650207b80e28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:51Z,use_quota=True,user_id='4e7034d4d4aa4a64afc5992f8963f714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Creating volume b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:51 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:51 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:28:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:51 devstack sudo[107375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7 1073741824 Jul 08 01:28:51 devstack sudo[107375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:51 devstack sudo[107375]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7 1073741824" returned: 0 in 0.818s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:51 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:51 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7 Jul 08 01:28:51 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:52 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7" returned: 0 in 0.615s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:52 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:52 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acbfa2cd-f5ca-49e0-85c9-2d7de4bb0e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5496f5fc-7680-4d46-a598-a33bf10ca41e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:52 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Volume volume-b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7 (b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7): created successfully Jul 08 01:28:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5496f5fc-7680-4d46-a598-a33bf10ca41e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:52 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Flow 'volume_create_manager' (9ae1aef3-981b-4529-8777-77847441e14d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:52 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-5a70eb25-d420-47ad-af77-5fff06a27b39 tempest-ProjectReaderTests-986313924 None] Created volume successfully. Jul 08 01:28:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-723df31a-6f6b-490a-beaf-d140ad693e33 tempest-ProjectReaderTests-986313924 None] Acquiring lock "cinder-b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-723df31a-6f6b-490a-beaf-d140ad693e33 tempest-ProjectReaderTests-986313924 None] Lock "cinder-b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-723df31a-6f6b-490a-beaf-d140ad693e33 tempest-ProjectReaderTests-986313924 None] Acquiring lock "cinder-quobyte-b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:53 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-723df31a-6f6b-490a-beaf-d140ad693e33 tempest-ProjectReaderTests-986313924 None] Lock "cinder-quobyte-b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7" acquired by "delete_volume" :: waited 0.024s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:53 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8d400b-ad93-495a-8b0a-cc382afddab7]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:53 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-723df31a-6f6b-490a-beaf-d140ad693e33 tempest-ProjectReaderTests-986313924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:53 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7 Jul 08 01:28:53 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:54 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-723df31a-6f6b-490a-beaf-d140ad693e33 tempest-ProjectReaderTests-986313924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7" returned: 0 in 0.765s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-723df31a-6f6b-490a-beaf-d140ad693e33 tempest-ProjectReaderTests-986313924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:54 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7 Jul 08 01:28:54 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:54 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-723df31a-6f6b-490a-beaf-d140ad693e33 tempest-ProjectReaderTests-986313924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7" returned: 0 in 0.642s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:54 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-723df31a-6f6b-490a-beaf-d140ad693e33 tempest-ProjectReaderTests-986313924 None] Lock "cinder-quobyte-b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7" released by "delete_volume" :: held 1.446s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:54 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-723df31a-6f6b-490a-beaf-d140ad693e33 tempest-ProjectReaderTests-986313924 None] Created reservations ['bc7b71fb-ff6f-4f34-870a-97933b8737a3', '5b6d3558-b645-4b6c-8bd7-0fb81dd58d3f', '5939d898-39c3-43cf-b782-6443b3e938a1', 'a6d65c96-f2e2-485a-9035-36f71e546e22'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-723df31a-6f6b-490a-beaf-d140ad693e33 tempest-ProjectReaderTests-986313924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-723df31a-6f6b-490a-beaf-d140ad693e33 tempest-ProjectReaderTests-986313924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-723df31a-6f6b-490a-beaf-d140ad693e33 tempest-ProjectReaderTests-986313924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:54 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-723df31a-6f6b-490a-beaf-d140ad693e33 tempest-ProjectReaderTests-986313924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-723df31a-6f6b-490a-beaf-d140ad693e33 tempest-ProjectReaderTests-986313924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:54 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-723df31a-6f6b-490a-beaf-d140ad693e33 tempest-ProjectReaderTests-986313924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:54 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:28:54 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:55 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:55 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-723df31a-6f6b-490a-beaf-d140ad693e33 tempest-ProjectReaderTests-986313924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.663s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:55 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-723df31a-6f6b-490a-beaf-d140ad693e33 tempest-ProjectReaderTests-986313924 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:28:55 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-723df31a-6f6b-490a-beaf-d140ad693e33 tempest-ProjectReaderTests-986313924 None] Deleted volume successfully. Jul 08 01:28:55 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-723df31a-6f6b-490a-beaf-d140ad693e33 tempest-ProjectReaderTests-986313924 None] Lock "cinder-b2653bed-f5ad-4b5e-b2b1-f9f4e615d9a7-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:55 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:28:55 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Flow 'volume_create_manager' (b4ef5f5f-1a5e-4a24-9d0e-fd5761839fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4f8ccf-75b3-422b-9a08-fad44b5ef29f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a4f8ccf-75b3-422b-9a08-fad44b5ef29f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-296320059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1526d332-aabe-46b0-be30-ecfab5e382b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='011918b2a9304d4cbc6a650207b80e28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:56Z,use_quota=True,user_id='4e7034d4d4aa4a64afc5992f8963f714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90dfd66-64c4-4987-b126-76c1ca2cef9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a90dfd66-64c4-4987-b126-76c1ca2cef9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26459ef1-2d70-450a-8418-b1c9b5dab10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26459ef1-2d70-450a-8418-b1c9b5dab10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1526d332-aabe-46b0-be30-ecfab5e382b2', 'volume_name': 'volume-1526d332-aabe-46b0-be30-ecfab5e382b2', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd38ae9f-4929-4aee-a6b5-866d72514051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd38ae9f-4929-4aee-a6b5-866d72514051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:56 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd23187-46be-4b5a-bcec-a0c094559f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:56 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Volume 1526d332-aabe-46b0-be30-ecfab5e382b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1526d332-aabe-46b0-be30-ecfab5e382b2', 'volume_size': 1} Jul 08 01:28:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:28:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-296320059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1526d332-aabe-46b0-be30-ecfab5e382b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='011918b2a9304d4cbc6a650207b80e28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:28:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:28:56Z,use_quota=True,user_id='4e7034d4d4aa4a64afc5992f8963f714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:28:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Creating volume 1526d332-aabe-46b0-be30-ecfab5e382b2 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:28:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:56 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:28:56 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:28:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1526d332-aabe-46b0-be30-ecfab5e382b2 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:56 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1526d332-aabe-46b0-be30-ecfab5e382b2 1073741824 Jul 08 01:28:56 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:56 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1526d332-aabe-46b0-be30-ecfab5e382b2 1073741824" returned: 0 in 0.869s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:56 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1526d332-aabe-46b0-be30-ecfab5e382b2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:57 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1526d332-aabe-46b0-be30-ecfab5e382b2 Jul 08 01:28:57 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:57 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1526d332-aabe-46b0-be30-ecfab5e382b2" returned: 0 in 0.684s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:57 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:28:57 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:57 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd23187-46be-4b5a-bcec-a0c094559f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1526d332-aabe-46b0-be30-ecfab5e382b2', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:57 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4e06cc-be5b-4aa4-9205-2e0368bf3ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:28:57 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Volume volume-1526d332-aabe-46b0-be30-ecfab5e382b2 (1526d332-aabe-46b0-be30-ecfab5e382b2): created successfully Jul 08 01:28:57 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc4e06cc-be5b-4aa4-9205-2e0368bf3ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:28:57 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Flow 'volume_create_manager' (b4ef5f5f-1a5e-4a24-9d0e-fd5761839fe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:28:57 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-d8d159e8-9128-4cb4-a103-0631924c3495 tempest-ProjectReaderTests-986313924 None] Created volume successfully. Jul 08 01:28:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e6e66bed-d633-402d-ad76-b56ded44c2e9 tempest-ProjectReaderTests-986313924 None] Acquiring lock "cinder-1526d332-aabe-46b0-be30-ecfab5e382b2-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e6e66bed-d633-402d-ad76-b56ded44c2e9 tempest-ProjectReaderTests-986313924 None] Lock "cinder-1526d332-aabe-46b0-be30-ecfab5e382b2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e6e66bed-d633-402d-ad76-b56ded44c2e9 tempest-ProjectReaderTests-986313924 None] Acquiring lock "cinder-quobyte-1526d332-aabe-46b0-be30-ecfab5e382b2" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:28:58 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e6e66bed-d633-402d-ad76-b56ded44c2e9 tempest-ProjectReaderTests-986313924 None] Lock "cinder-quobyte-1526d332-aabe-46b0-be30-ecfab5e382b2" acquired by "delete_volume" :: waited 0.024s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:28:58 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b91c77a-1068-4d70-9edc-bacc1814a3da]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:28:58 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e6e66bed-d633-402d-ad76-b56ded44c2e9 tempest-ProjectReaderTests-986313924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1526d332-aabe-46b0-be30-ecfab5e382b2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:58 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1526d332-aabe-46b0-be30-ecfab5e382b2 Jul 08 01:28:58 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:59 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e6e66bed-d633-402d-ad76-b56ded44c2e9 tempest-ProjectReaderTests-986313924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1526d332-aabe-46b0-be30-ecfab5e382b2" returned: 0 in 0.780s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e6e66bed-d633-402d-ad76-b56ded44c2e9 tempest-ProjectReaderTests-986313924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1526d332-aabe-46b0-be30-ecfab5e382b2 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:59 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1526d332-aabe-46b0-be30-ecfab5e382b2 Jul 08 01:28:59 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:28:59 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Jul 08 01:28:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e6e66bed-d633-402d-ad76-b56ded44c2e9 tempest-ProjectReaderTests-986313924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-1526d332-aabe-46b0-be30-ecfab5e382b2" returned: 0 in 0.688s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:28:59 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e6e66bed-d633-402d-ad76-b56ded44c2e9 tempest-ProjectReaderTests-986313924 None] Lock "cinder-quobyte-1526d332-aabe-46b0-be30-ecfab5e382b2" released by "delete_volume" :: held 1.514s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:28:59 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-e6e66bed-d633-402d-ad76-b56ded44c2e9 tempest-ProjectReaderTests-986313924 None] Created reservations ['6fc0efa3-9c39-4cf3-bb8b-f19652a2fd6d', '384894e4-2b67-4b1b-8e66-bb10893baf4b', 'c80defd8-739f-4875-9bc2-7d7be6dc6a98', 'de0ddd7c-76df-4104-ba2d-9b3712299ca5'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:28:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e6e66bed-d633-402d-ad76-b56ded44c2e9 tempest-ProjectReaderTests-986313924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:28:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e6e66bed-d633-402d-ad76-b56ded44c2e9 tempest-ProjectReaderTests-986313924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:28:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e6e66bed-d633-402d-ad76-b56ded44c2e9 tempest-ProjectReaderTests-986313924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:28:59 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-e6e66bed-d633-402d-ad76-b56ded44c2e9 tempest-ProjectReaderTests-986313924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:28:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-e6e66bed-d633-402d-ad76-b56ded44c2e9 tempest-ProjectReaderTests-986313924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:28:59 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e6e66bed-d633-402d-ad76-b56ded44c2e9 tempest-ProjectReaderTests-986313924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:28:59 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:28:59 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:00 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-e6e66bed-d633-402d-ad76-b56ded44c2e9 tempest-ProjectReaderTests-986313924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.682s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-e6e66bed-d633-402d-ad76-b56ded44c2e9 tempest-ProjectReaderTests-986313924 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:29:00 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-e6e66bed-d633-402d-ad76-b56ded44c2e9 tempest-ProjectReaderTests-986313924 None] Deleted volume successfully. Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-e6e66bed-d633-402d-ad76-b56ded44c2e9 tempest-ProjectReaderTests-986313924 None] Lock "cinder-1526d332-aabe-46b0-be30-ecfab5e382b2-delete_volume" released by "delete_volume" :: held 2.437s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Flow 'volume_create_manager' (95b8a4e5-26ee-4e79-a684-535ec1403618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (391cbd7f-c4ab-4e28-a9fa-23f2b13e51f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (391cbd7f-c4ab-4e28-a9fa-23f2b13e51f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-843653095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edafaa45-d1e3-492c-b11c-37d6ee6407b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='011918b2a9304d4cbc6a650207b80e28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:01Z,use_quota=True,user_id='4e7034d4d4aa4a64afc5992f8963f714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2083f87-6c7f-4349-a68c-34d747c53226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2083f87-6c7f-4349-a68c-34d747c53226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f237f0ea-fe3e-4d7c-94b3-97a7ceeb0f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f237f0ea-fe3e-4d7c-94b3-97a7ceeb0f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edafaa45-d1e3-492c-b11c-37d6ee6407b0', 'volume_name': 'volume-edafaa45-d1e3-492c-b11c-37d6ee6407b0', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6b7cef-4f4b-49d8-bf6e-f09849913ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a6b7cef-4f4b-49d8-bf6e-f09849913ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa41f9e8-1549-4c52-807e-90fe43758da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:00 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Volume edafaa45-d1e3-492c-b11c-37d6ee6407b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edafaa45-d1e3-492c-b11c-37d6ee6407b0', 'volume_size': 1} Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-843653095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edafaa45-d1e3-492c-b11c-37d6ee6407b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='011918b2a9304d4cbc6a650207b80e28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:01Z,use_quota=True,user_id='4e7034d4d4aa4a64afc5992f8963f714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Creating volume edafaa45-d1e3-492c-b11c-37d6ee6407b0 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:29:00 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:29:00 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-edafaa45-d1e3-492c-b11c-37d6ee6407b0 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:01 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-edafaa45-d1e3-492c-b11c-37d6ee6407b0 1073741824 Jul 08 01:29:01 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:01 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-edafaa45-d1e3-492c-b11c-37d6ee6407b0 1073741824" returned: 0 in 0.863s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:01 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-edafaa45-d1e3-492c-b11c-37d6ee6407b0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:01 devstack sudo[107422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-edafaa45-d1e3-492c-b11c-37d6ee6407b0 Jul 08 01:29:01 devstack sudo[107422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:02 devstack sudo[107422]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-edafaa45-d1e3-492c-b11c-37d6ee6407b0" returned: 0 in 0.730s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:02 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] <== create_volume: return (1637ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:29:02 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.639s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa41f9e8-1549-4c52-807e-90fe43758da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edafaa45-d1e3-492c-b11c-37d6ee6407b0', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08fefa8f-b22f-46b5-86e7-555a5e60ae6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:02 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Volume volume-edafaa45-d1e3-492c-b11c-37d6ee6407b0 (edafaa45-d1e3-492c-b11c-37d6ee6407b0): created successfully Jul 08 01:29:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08fefa8f-b22f-46b5-86e7-555a5e60ae6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:02 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Flow 'volume_create_manager' (95b8a4e5-26ee-4e79-a684-535ec1403618) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:02 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-b493e1ff-ba3e-4899-b875-f2d73a953273 tempest-ProjectReaderTests-986313924 None] Created volume successfully. Jul 08 01:29:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-db63edd6-b68a-4d30-9136-6019244fd7c3 tempest-ProjectReaderTests-986313924 None] Acquiring lock "cinder-edafaa45-d1e3-492c-b11c-37d6ee6407b0-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-db63edd6-b68a-4d30-9136-6019244fd7c3 tempest-ProjectReaderTests-986313924 None] Lock "cinder-edafaa45-d1e3-492c-b11c-37d6ee6407b0-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-db63edd6-b68a-4d30-9136-6019244fd7c3 tempest-ProjectReaderTests-986313924 None] Acquiring lock "cinder-quobyte-edafaa45-d1e3-492c-b11c-37d6ee6407b0" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:03 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-db63edd6-b68a-4d30-9136-6019244fd7c3 tempest-ProjectReaderTests-986313924 None] Lock "cinder-quobyte-edafaa45-d1e3-492c-b11c-37d6ee6407b0" acquired by "delete_volume" :: waited 0.019s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:03 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b394c02-6a64-4adf-8029-6807fe958b85]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-db63edd6-b68a-4d30-9136-6019244fd7c3 tempest-ProjectReaderTests-986313924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-edafaa45-d1e3-492c-b11c-37d6ee6407b0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:03 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-edafaa45-d1e3-492c-b11c-37d6ee6407b0 Jul 08 01:29:03 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:03 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-db63edd6-b68a-4d30-9136-6019244fd7c3 tempest-ProjectReaderTests-986313924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-edafaa45-d1e3-492c-b11c-37d6ee6407b0" returned: 0 in 0.777s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:03 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-db63edd6-b68a-4d30-9136-6019244fd7c3 tempest-ProjectReaderTests-986313924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-edafaa45-d1e3-492c-b11c-37d6ee6407b0 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:03 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-edafaa45-d1e3-492c-b11c-37d6ee6407b0 Jul 08 01:29:03 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:04 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-db63edd6-b68a-4d30-9136-6019244fd7c3 tempest-ProjectReaderTests-986313924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-edafaa45-d1e3-492c-b11c-37d6ee6407b0" returned: 0 in 0.644s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:04 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-db63edd6-b68a-4d30-9136-6019244fd7c3 tempest-ProjectReaderTests-986313924 None] Lock "cinder-quobyte-edafaa45-d1e3-492c-b11c-37d6ee6407b0" released by "delete_volume" :: held 1.471s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:04 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-db63edd6-b68a-4d30-9136-6019244fd7c3 tempest-ProjectReaderTests-986313924 None] Created reservations ['11f75c32-b088-49d3-aaaf-2b5e56c825b3', '227b453e-2491-4f40-ae72-b70bf63e4622', '1e18c7bc-fa70-42fc-b420-873223632445', '73251eaa-78bf-413f-a462-254c10978cd0'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-db63edd6-b68a-4d30-9136-6019244fd7c3 tempest-ProjectReaderTests-986313924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-db63edd6-b68a-4d30-9136-6019244fd7c3 tempest-ProjectReaderTests-986313924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:04 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-db63edd6-b68a-4d30-9136-6019244fd7c3 tempest-ProjectReaderTests-986313924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:04 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-db63edd6-b68a-4d30-9136-6019244fd7c3 tempest-ProjectReaderTests-986313924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-db63edd6-b68a-4d30-9136-6019244fd7c3 tempest-ProjectReaderTests-986313924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:04 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-db63edd6-b68a-4d30-9136-6019244fd7c3 tempest-ProjectReaderTests-986313924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:04 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:29:04 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:05 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-db63edd6-b68a-4d30-9136-6019244fd7c3 tempest-ProjectReaderTests-986313924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.677s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-db63edd6-b68a-4d30-9136-6019244fd7c3 tempest-ProjectReaderTests-986313924 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:29:05 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-db63edd6-b68a-4d30-9136-6019244fd7c3 tempest-ProjectReaderTests-986313924 None] Deleted volume successfully. Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-db63edd6-b68a-4d30-9136-6019244fd7c3 tempest-ProjectReaderTests-986313924 None] Lock "cinder-edafaa45-d1e3-492c-b11c-37d6ee6407b0-delete_volume" released by "delete_volume" :: held 2.382s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87123) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Flow 'volume_create_manager' (d1300732-3bd2-42fe-90fb-236660723c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e15584-ffd6-45bc-9706-32e46414addb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e15584-ffd6-45bc-9706-32e46414addb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1438638669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7458b7b-f926-49f5-8107-7b7e42e50b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='011918b2a9304d4cbc6a650207b80e28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:06Z,use_quota=True,user_id='4e7034d4d4aa4a64afc5992f8963f714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ba81fc-0dca-4291-949e-8a1b216adb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5ba81fc-0dca-4291-949e-8a1b216adb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b95e73e-af1d-44a1-bc40-52141f99b130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b95e73e-af1d-44a1-bc40-52141f99b130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7458b7b-f926-49f5-8107-7b7e42e50b62', 'volume_name': 'volume-f7458b7b-f926-49f5-8107-7b7e42e50b62', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f7d30d-4c8f-4174-931d-5a45a75434b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8f7d30d-4c8f-4174-931d-5a45a75434b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5357735-f73a-4c4f-8696-4517c231870a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:05 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Volume f7458b7b-f926-49f5-8107-7b7e42e50b62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7458b7b-f926-49f5-8107-7b7e42e50b62', 'volume_size': 1} Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-07T23:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1438638669',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7458b7b-f926-49f5-8107-7b7e42e50b62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='011918b2a9304d4cbc6a650207b80e28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-07T23:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-07T23:29:06Z,use_quota=True,user_id='4e7034d4d4aa4a64afc5992f8963f714',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d5469519-02b5-4653-9167-2208b1bfc08f),volume_type_id=d5469519-02b5-4653-9167-2208b1bfc08f)}" {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.remotefs [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Creating volume f7458b7b-f926-49f5-8107-7b7e42e50b62 {{(pid=87123) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Selected osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e as target Quobyte volume. {{(pid=87123) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 08 01:29:05 devstack cinder-volume[87123]: INFO cinder.volume.drivers.remotefs [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] casted to osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e Jul 08 01:29:05 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f7458b7b-f926-49f5-8107-7b7e42e50b62 1073741824 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:05 devstack sudo[107436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f7458b7b-f926-49f5-8107-7b7e42e50b62 1073741824 Jul 08 01:29:05 devstack sudo[107436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:06 devstack sudo[107436]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f7458b7b-f926-49f5-8107-7b7e42e50b62 1073741824" returned: 0 in 0.789s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:06 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f7458b7b-f926-49f5-8107-7b7e42e50b62 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:06 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f7458b7b-f926-49f5-8107-7b7e42e50b62 Jul 08 01:29:06 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:07 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f7458b7b-f926-49f5-8107-7b7e42e50b62" returned: 0 in 0.677s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:07 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'} {{(pid=87123) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 08 01:29:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5357735-f73a-4c4f-8696-4517c231870a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7458b7b-f926-49f5-8107-7b7e42e50b62', 'volume_size': 1}' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e419dc4b-d0c2-4f4c-9572-2a8adc7687f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 08 01:29:07 devstack cinder-volume[87123]: INFO cinder.volume.flows.manager.create_volume [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Volume volume-f7458b7b-f926-49f5-8107-7b7e42e50b62 (f7458b7b-f926-49f5-8107-7b7e42e50b62): created successfully Jul 08 01:29:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e419dc4b-d0c2-4f4c-9572-2a8adc7687f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87123) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 08 01:29:07 devstack cinder-volume[87123]: DEBUG cinder.volume.manager [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Flow 'volume_create_manager' (d1300732-3bd2-42fe-90fb-236660723c01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87123) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 08 01:29:07 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-4eafe82a-78fb-421f-81f5-195c432575ce tempest-ProjectReaderTests-986313924 None] Created volume successfully. Jul 08 01:29:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eac0155f-751f-4570-af4e-b8cfe94df86c tempest-ProjectReaderTests-986313924 None] Acquiring lock "cinder-f7458b7b-f926-49f5-8107-7b7e42e50b62-delete_volume" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eac0155f-751f-4570-af4e-b8cfe94df86c tempest-ProjectReaderTests-986313924 None] Lock "cinder-f7458b7b-f926-49f5-8107-7b7e42e50b62-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eac0155f-751f-4570-af4e-b8cfe94df86c tempest-ProjectReaderTests-986313924 None] Acquiring lock "cinder-quobyte-f7458b7b-f926-49f5-8107-7b7e42e50b62" by "delete_volume" {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 08 01:29:07 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eac0155f-751f-4570-af4e-b8cfe94df86c tempest-ProjectReaderTests-986313924 None] Lock "cinder-quobyte-f7458b7b-f926-49f5-8107-7b7e42e50b62" acquired by "delete_volume" :: waited 0.017s {{(pid=87123) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 08 01:29:07 devstack cinder-volume[87123]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e24d6f-911e-451b-b281-d518ca878fe8]: (4, 'qcow2') {{(pid=88450) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 08 01:29:07 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eac0155f-751f-4570-af4e-b8cfe94df86c tempest-ProjectReaderTests-986313924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f7458b7b-f926-49f5-8107-7b7e42e50b62 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:08 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f7458b7b-f926-49f5-8107-7b7e42e50b62 Jul 08 01:29:08 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:08 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eac0155f-751f-4570-af4e-b8cfe94df86c tempest-ProjectReaderTests-986313924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f7458b7b-f926-49f5-8107-7b7e42e50b62" returned: 0 in 0.768s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:08 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eac0155f-751f-4570-af4e-b8cfe94df86c tempest-ProjectReaderTests-986313924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f7458b7b-f926-49f5-8107-7b7e42e50b62 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:08 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f7458b7b-f926-49f5-8107-7b7e42e50b62 Jul 08 01:29:08 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:09 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eac0155f-751f-4570-af4e-b8cfe94df86c tempest-ProjectReaderTests-986313924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77/volume-f7458b7b-f926-49f5-8107-7b7e42e50b62" returned: 0 in 0.674s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:09 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eac0155f-751f-4570-af4e-b8cfe94df86c tempest-ProjectReaderTests-986313924 None] Lock "cinder-quobyte-f7458b7b-f926-49f5-8107-7b7e42e50b62" released by "delete_volume" :: held 1.483s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:09 devstack cinder-volume[87123]: DEBUG cinder.quota [None req-eac0155f-751f-4570-af4e-b8cfe94df86c tempest-ProjectReaderTests-986313924 None] Created reservations ['871c024a-c5e5-44aa-ae9b-02b37c243cc8', 'b16827bb-772f-4238-aad4-3ff6afa77bb3', 'c423f37e-e4b1-46d1-b4ef-558a47c7d8b0', '5e79c1ed-5fd2-41bf-831c-d97801a67ec9'] {{(pid=87123) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 08 01:29:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-eac0155f-751f-4570-af4e-b8cfe94df86c tempest-ProjectReaderTests-986313924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 08 01:29:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-eac0155f-751f-4570-af4e-b8cfe94df86c tempest-ProjectReaderTests-986313924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 08 01:29:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-eac0155f-751f-4570-af4e-b8cfe94df86c tempest-ProjectReaderTests-986313924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e': None} {{(pid=87123) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 08 01:29:09 devstack cinder-volume[87123]: DEBUG cinder.volume.drivers.quobyte [None req-eac0155f-751f-4570-af4e-b8cfe94df86c tempest-ProjectReaderTests-986313924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-21e66b4c-00ad-4dff-958b-df3a653a812e'] {{(pid=87123) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 08 01:29:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.lockutils [None req-eac0155f-751f-4570-af4e-b8cfe94df86c tempest-ProjectReaderTests-986313924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87123) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 08 01:29:09 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eac0155f-751f-4570-af4e-b8cfe94df86c tempest-ProjectReaderTests-986313924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 08 01:29:09 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77 Jul 08 01:29:09 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 08 01:29:10 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Jul 08 01:29:10 devstack cinder-volume[87123]: DEBUG oslo_concurrency.processutils [None req-eac0155f-751f-4570-af4e-b8cfe94df86c tempest-ProjectReaderTests-986313924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e357ac605aeeb29365ca8852011a2f77" returned: 0 in 0.669s {{(pid=87123) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 08 01:29:10 devstack cinder-volume[87123]: DEBUG cinder.manager [None req-eac0155f-751f-4570-af4e-b8cfe94df86c tempest-ProjectReaderTests-986313924 None] Notifying Schedulers of capabilities ... {{(pid=87123) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 08 01:29:10 devstack cinder-volume[87123]: INFO cinder.volume.manager [None req-eac0155f-751f-4570-af4e-b8cfe94df86c tempest-ProjectReaderTests-986313924 None] Deleted volume successfully. Jul 08 01:29:10 devstack cinder-volume[87123]: DEBUG cinder.coordination [None req-eac0155f-751f-4570-af4e-b8cfe94df86c tempest-ProjectReaderTests-986313924 None] Lock "cinder-f7458b7b-f926-49f5-8107-7b7e42e50b62-delete_volume" released by "delete_volume" :: held 2.360s {{(pid=87123) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 08 01:29:19 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:SELECT=43,cinder:INSERT=17,cinder:UPDATE=53,cinder:DELETE=2 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 08 01:29:20 devstack cinder-volume[87123]: DEBUG dbcounter [-] [87123] Writing DB stats cinder:INSERT=11,cinder:UPDATE=63,cinder:SELECT=31,cinder:DELETE=7 {{(pid=87123) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}